[ 598.395217] env[69358]: INFO neutron.common.config [-] Logging enabled! [ 598.395463] env[69358]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.0.0.0rc2.dev50 [ 598.395693] env[69358]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69358) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 598.395991] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 598.396103] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 598.396908] env[69358]: WARNING oslo_policy.policy [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 598.397142] env[69358]: WARNING oslo_policy.policy [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 598.398607] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] VMware NSXv3 Agent initialized successfully. [ 598.398960] env[69358]: DEBUG oslo_concurrency.lockutils [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] Acquiring lock "singleton_lock" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.399127] env[69358]: DEBUG oslo_concurrency.lockutils [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] Acquired lock "singleton_lock" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.399422] env[69358]: DEBUG oslo_concurrency.lockutils [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] Releasing lock "singleton_lock" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.399617] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] Full set of CONF: {{(pid=69358) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 598.399831] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ******************************************************************************** {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 598.400822] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] Configuration options gathered from: {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 598.400822] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 598.400822] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 598.400822] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ================================================================================ {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 598.400822] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] agent_down_time = 75 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.400822] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] allow_automatic_dhcp_failover = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401108] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] allow_bulk = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401108] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] api_extensions_path = {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401248] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] api_paste_config = api-paste.ini {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401333] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] auth_strategy = keystone {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401441] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] backdoor_port = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401546] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] backdoor_socket = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401683] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] backlog = 4096 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401823] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.401981] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] bind_host = 0.0.0.0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.402173] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] bind_port = 9696 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403219] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] client_socket_timeout = 900 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403219] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] config_dir = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403219] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403219] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] config_source = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403219] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] control_exchange = neutron {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403219] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] core_plugin = ml2 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403445] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] debug = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403445] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] default_availability_zones = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403445] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403655] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] dhcp_agent_notification = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403724] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] dhcp_agents_per_network = 1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.403861] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] dhcp_lease_duration = 86400 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.404023] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] dhcp_load_type = networks {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.404168] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] dns_domain = openstacklocal {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.404511] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.404601] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] enable_default_route_bfd = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.404711] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] enable_default_route_ecmp = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.404849] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] enable_dvr = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.405102] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] enable_new_agents = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.405179] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.405320] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] enable_signals = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.405472] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] enable_traditional_dhcp = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.405768] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] external_dns_driver = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.405835] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] filter_validation = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.406253] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] global_physnet_mtu = 8950 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.406253] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] graceful_shutdown_timeout = 60 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.406314] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] host = cpu-1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.406554] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] host_dvr_for_dhcp = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.406554] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] http_retries = 3 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408031] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] instance_format = [instance: %(uuid)s] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408031] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408031] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ipam_driver = internal {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408031] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ipv6_pd_enabled = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408031] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] l3_ha = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408031] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408194] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] l3_ha_network_physical_name = {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408194] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] l3_ha_network_type = {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408194] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_color = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408194] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_config_append = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408194] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408319] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_dir = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408439] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_file = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.408550] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_options = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409232] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_rotate_interval = 1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409232] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_rotate_interval_type = days {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409232] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] log_rotation_type = none {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409232] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409232] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409418] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409522] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409664] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.409823] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] max_dns_nameservers = 5 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.410390] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] max_header_line = 16384 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.410390] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] max_l3_agents_per_router = 3 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.410390] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] max_logfile_count = 30 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.410390] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] max_logfile_size_mb = 200 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.410630] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] max_subnet_host_routes = 20 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.410794] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] my_ip = 10.180.1.21 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.410794] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] my_ipv6 = ::1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.411782] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] network_auto_schedule = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.411782] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] network_link_prefix = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.411782] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.411782] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] notify_nova_on_port_data_changes = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.411782] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] notify_nova_on_port_status_changes = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.411782] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] pagination_max_limit = -1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.411980] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] publish_errors = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.411980] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] rate_limit_burst = 0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.412099] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] rate_limit_except_level = CRITICAL {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.412203] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] rate_limit_interval = 0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.412280] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] retry_until_window = 30 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.412412] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] router_distributed = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.412545] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] rpc_resources_processing_step = 20 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.412675] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] rpc_response_max_timeout = 600 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.412810] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] rpc_response_timeout = 60 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.413153] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] send_events_interval = 2 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.413153] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] service_plugins = ['router'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.413271] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] setproctitle = on {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.413370] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] shell_completion = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.413512] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] state_path = /opt/stack/data/neutron {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.413654] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] syslog_log_facility = LOG_USER {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.414023] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] tcp_keepidle = 600 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.414023] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] transport_url = **** {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.414185] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] use_journal = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.414238] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] use_json = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.414327] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] use_ssl = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.414466] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] use_stderr = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415084] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] use_syslog = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415084] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] vlan_qinq = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415084] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] vlan_transparent = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415084] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] watch_log_file = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415246] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] wsgi_default_pool_size = 100 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415349] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] wsgi_keep_alive = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415581] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415828] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] wsgi_server_debug = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.415908] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_concurrency.disable_process_locking = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.416046] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.416195] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418409] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418409] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418409] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418409] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418409] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.connection_string = messaging:// {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418409] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.enabled = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418638] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.es_doc_type = notification {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418638] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.es_scroll_size = 10000 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418638] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.es_scroll_time = 2m {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418638] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.filter_error_trace = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418638] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.hmac_keys = **** {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418638] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.sentinel_service_name = mymaster {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418638] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.socket_timeout = 0.1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418809] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.trace_requests = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418809] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler.trace_sqlalchemy = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418809] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler_jaeger.process_tags = {} {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418809] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler_jaeger.service_name_prefix = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.418914] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] profiler_otlp.service_name_prefix = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.419074] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.enforce_new_defaults = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.419250] env[69358]: WARNING oslo_config.cfg [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 598.419400] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.enforce_scope = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.419545] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.policy_default_rule = default {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.419696] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.419839] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.419981] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.420126] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.420261] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.420391] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.420539] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.420682] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.420832] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.420975] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] agent.extensions = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.421129] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.421272] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] service_providers.service_provider = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.422145] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.default_quota = -1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.422145] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.422145] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_floatingip = 50 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.422145] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_network = 100 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.422145] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_port = 500 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.422360] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424297] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_router = 10 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424297] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_security_group = 10 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424297] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424297] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.quota_subnet = 100 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424297] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] QUOTAS.track_quota_usage = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424297] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424297] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep.group = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424565] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep.helper_command = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424565] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424565] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep.thread_pool_size = 8 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424565] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep.user = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424565] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424765] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_dhcp_release.group = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.424837] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_dhcp_release.helper_command = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.425536] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.425536] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.425536] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_dhcp_release.user = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.425536] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.425536] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_ovs_vsctl.group = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.426425] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.426425] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.426425] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.426425] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_ovs_vsctl.user = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.426425] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_namespace.capabilities = [21] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.426425] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_namespace.group = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427387] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_namespace.helper_command = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427387] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427387] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427387] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_namespace.user = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427387] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_conntrack.capabilities = [12] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427387] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_conntrack.group = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427387] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_conntrack.helper_command = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427725] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427725] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427725] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_conntrack.user = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427864] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_link.capabilities = [12, 21] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.427964] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_link.group = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.428104] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_link.helper_command = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.428509] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.428509] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_link.thread_pool_size = 8 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.428509] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] privsep_link.user = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.428697] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.428829] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.428966] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.continue_on_failed_promotions = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.429289] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.dscp = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.429289] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.dscp_inherit = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.429434] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.force_mp_to_policy = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.429525] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.locking_coordinator_url = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.429662] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.log_agent_heartbeats = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.430467] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.logging_expire = 1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.430467] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.430467] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.430467] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.polling_interval = 240 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.430467] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.430639] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.430639] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.report_interval = 30.0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.430772] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.432816] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.432816] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.432816] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.sync_skew = 60 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.432816] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.synchronization_queue_size = 20 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.432816] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT.use_helper_for_ns_read = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.432816] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] SECURITYGROUP.enable_ipset = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433154] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] SECURITYGROUP.enable_security_group = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433154] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433154] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433154] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] experimental.ipv6_pd_enabled = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433154] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.extension_drivers = ['port_security'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433154] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.external_network_type = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433424] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433424] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.overlay_ip_version = 4 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433424] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.path_mtu = 8950 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433424] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.physical_network_mtus = {} {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433424] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433424] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433424] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ml2.type_drivers = ['vlan'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433723] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433723] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433822] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.433967] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.434122] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.434262] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.434401] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.434543] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.434681] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.434863] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.435442] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_login_password = **** {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.435442] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.435442] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_login_user = admin {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.435442] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.436398] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.436398] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.436398] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.436398] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.436398] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.436398] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437076] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437076] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437076] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437076] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437076] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437334] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437334] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437479] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.437651] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438175] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438175] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.auth_section = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438175] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.auth_type = password {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438358] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438358] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.certfile = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438490] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.collect_timing = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438650] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.endpoint_type = public {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438786] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.insecure = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.438920] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.keyfile = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.439145] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.region_name = RegionOne {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.439227] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.split_loggers = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.439622] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] nova.timeout = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.439622] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.auth_section = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.439622] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.auth_type = password {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.439787] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.439891] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.certfile = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.440033] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.collect_timing = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.440175] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.endpoint_type = public {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.440827] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.insecure = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.440827] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.keyfile = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.440827] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.region_name = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.440827] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.split_loggers = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.440827] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] placement.timeout = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.441009] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.auth_section = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.441105] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.auth_type = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.441225] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.cafile = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.441353] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.certfile = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.441487] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.collect_timing = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.441628] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.connect_retries = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.441760] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.connect_retry_delay = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.441914] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.enable_notifications = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.442079] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.endpoint_override = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.442538] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.insecure = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.442538] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.interface = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.442538] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.keyfile = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.442538] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.max_version = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.442684] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.min_version = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443062] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.region_name = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443062] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.retriable_status_codes = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443062] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.service_name = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443258] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.service_type = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443684] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.split_loggers = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443684] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.status_code_retries = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443684] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.status_code_retry_delay = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443684] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.timeout = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443845] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.valid_interfaces = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.443942] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ironic.version = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.444088] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] cli_script.dry_run = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.444233] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.444897] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.444897] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.444897] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.444897] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.444897] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.445079] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.445168] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.445300] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.445458] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.445599] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.445741] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.446309] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.446309] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.446309] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.446415] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.446481] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.446592] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.446732] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.446975] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.447059] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.447144] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.447498] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.447498] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.447592] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.447736] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.448097] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.448097] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.448480] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.448480] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.448554] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.ssl = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.448862] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.449171] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.449171] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.449306] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.449379] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.449688] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.449688] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_notifications.driver = [] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.449811] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_notifications.retry = -1 {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.449953] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.450279] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.450279] env[69358]: DEBUG oslo_service.backend.eventlet.service [None req-51dd2d17-9c10-400a-9a17-2697c64ba645 None None] ******************************************************************************** {{(pid=69358) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 598.451154] env[69358]: DEBUG neutron.agent.securitygroups_rpc [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Init firewall settings (driver=nsxv3) {{(pid=69358) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 598.452883] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69358) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 598.452883] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] RPC agent_id: nsxm-l-01a.corp.local [ 598.454825] env[69358]: DEBUG dogpile.cache.region [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.455308] env[69358]: DEBUG dogpile.lock [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.455308] env[69358]: DEBUG dogpile.lock [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.455308] env[69358]: DEBUG dogpile.lock [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.455308] env[69358]: DEBUG dogpile.cache.region [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.455308] env[69358]: DEBUG dogpile.lock [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.455791] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.480877] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Session token - acquiring [ 598.482341] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.482532] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.482597] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.482994] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.492749] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.769965] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 598.789732] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.789950] env[69358]: DEBUG dogpile.cache.region [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Cache value generated in 0.334 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 598.790110] env[69358]: DEBUG dogpile.lock [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.790237] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Activating Policy API Provider. [ 598.790435] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Looking for the default Infrastructure Rules. [ 598.850155] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Looking for the Default Layer3 Logged Drop Section. [ 598.868777] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 598.869213] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.869381] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.869485] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.869749] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.870161] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.386740] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.889084] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.391335] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Inventory metadata is going to be refreshed. [ 600.391581] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 601.207174] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.207725] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.207725] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.207874] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.219898] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 601.327054] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.328201] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 601.346314] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.346627] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.346627] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.346890] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.347025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.347180] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 601.347295] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.347400] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 601.368365] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.368639] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.368639] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.368930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.369114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.369257] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 601.392474] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.392702] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.392771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.393024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.393129] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.393266] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 601.413963] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.414158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.414218] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.414459] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.414590] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.414731] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 601.414836] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.414937] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 601.438998] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.439197] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.439258] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.439487] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.439603] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.439735] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 601.439839] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.439941] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 601.469480] env[69358]: DEBUG networking_nsxv3.common.locking [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.469628] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.469738] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.469933] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.470076] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.470219] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 601.470324] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.470423] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Inventory metadata have been refreshed. [ 601.470519] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Dryrun:True. Metadata refresh completed. [ 601.470636] env[69358]: DEBUG oslo_concurrency.lockutils [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Releasing lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.472373] env[69358]: INFO neutron.agent.agent_extensions_manager [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Loaded agent extensions: [] [ 601.473064] env[69358]: DEBUG neutron_lib.callbacks.manager [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69358) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 601.534582] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent RPC Daemon Started! [ 601.534686] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:0 started [ 601.534796] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent out of sync with plugin! [ 606.473881] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 606.474289] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 611.474720] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 611.474720] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 615.253968] env[69358]: INFO networking_nsxv3.common.synchronization [None req-99f946da-e5bd-4b82-ab6c-cc7dc41ce452 demo admin] Enqueued Resource ID: 5b5451b8-10d3-469e-8216-f1005c006c94 with Priority: HIGHEST for action security_group_rules [ 615.254491] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5451b8-10d3-469e-8216-f1005c006c94 with Priority: HIGHEST for action security_group_rules [ 615.254784] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b5451b8-10d3-469e-8216-f1005c006c94 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.254911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b5451b8-10d3-469e-8216-f1005c006c94" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.254982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b5451b8-10d3-469e-8216-f1005c006c94" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.255332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b5451b8-10d3-469e-8216-f1005c006c94" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.255418] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b5451b8-10d3-469e-8216-f1005c006c94',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.774940] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.775172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.775172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.775343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.775430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.775522] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b5451b8-10d3-469e-8216-f1005c006c94 already deleted. [ 615.775599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b5451b8-10d3-469e-8216-f1005c006c94" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.256032] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 620.256425] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 625.257078] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 625.257502] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 630.258705] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 630.259150] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 635.261038] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 635.261038] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 640.261137] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 640.261449] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 641.514655] env[69358]: INFO networking_nsxv3.common.synchronization [None req-62e3fb2f-6978-46d4-a253-011fffa39ea0 None None] Enqueued Resource ID: f6bdb3f0-3747-49c6-9935-cc87f7136c15 with Priority: HIGHEST for action port [ 641.515522] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bdb3f0-3747-49c6-9935-cc87f7136c15 with Priority: HIGHEST for action port [ 641.516309] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6bdb3f0-3747-49c6-9935-cc87f7136c15 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.516912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6bdb3f0-3747-49c6-9935-cc87f7136c15" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.517912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6bdb3f0-3747-49c6-9935-cc87f7136c15" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.518175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6bdb3f0-3747-49c6-9935-cc87f7136c15" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.518265] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6bdb3f0-3747-49c6-9935-cc87f7136c15',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.020530] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6bdb3f0-3747-49c6-9935-cc87f7136c15 [ 642.020830] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.020997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.021336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.021778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.021778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.022427] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6bdb3f0-3747-49c6-9935-cc87f7136c15 already deleted. [ 642.022631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6bdb3f0-3747-49c6-9935-cc87f7136c15" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.413269] env[69358]: INFO networking_nsxv3.common.synchronization [None req-bea4ea5e-a613-4a48-bd04-f3bfce631c9e None None] Enqueued Resource ID: ea23dadd-bbbd-4b9d-a157-0fc9bbf35395 with Priority: HIGHEST for action port [ 643.413534] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea23dadd-bbbd-4b9d-a157-0fc9bbf35395 with Priority: HIGHEST for action port [ 643.414111] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea23dadd-bbbd-4b9d-a157-0fc9bbf35395 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.414246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea23dadd-bbbd-4b9d-a157-0fc9bbf35395" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.414317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea23dadd-bbbd-4b9d-a157-0fc9bbf35395" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.415302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea23dadd-bbbd-4b9d-a157-0fc9bbf35395" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.416852] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea23dadd-bbbd-4b9d-a157-0fc9bbf35395',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.919565] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea23dadd-bbbd-4b9d-a157-0fc9bbf35395 [ 643.920667] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.920667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.921572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.921572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.921572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.921572] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea23dadd-bbbd-4b9d-a157-0fc9bbf35395 already deleted. [ 643.921572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea23dadd-bbbd-4b9d-a157-0fc9bbf35395" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.441431] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ad59111d-f108-4dab-8292-9759c1b13db4 None None] Enqueued Resource ID: 6a9c2626-f236-4e95-8009-3b131bea6b54 with Priority: HIGHEST for action port [ 645.442867] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a9c2626-f236-4e95-8009-3b131bea6b54 with Priority: HIGHEST for action port [ 645.442867] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a9c2626-f236-4e95-8009-3b131bea6b54 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.442867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a9c2626-f236-4e95-8009-3b131bea6b54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.443040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a9c2626-f236-4e95-8009-3b131bea6b54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.443404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a9c2626-f236-4e95-8009-3b131bea6b54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.443582] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a9c2626-f236-4e95-8009-3b131bea6b54',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.894372] env[69358]: INFO networking_nsxv3.common.synchronization [None req-641a2c89-7678-4eba-b73f-e4e8afcc0dc1 None None] Enqueued Resource ID: e906eb38-119b-4591-aa52-87d3f4da4521 with Priority: HIGHEST for action port [ 645.894372] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e906eb38-119b-4591-aa52-87d3f4da4521 with Priority: HIGHEST for action port [ 645.894372] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e906eb38-119b-4591-aa52-87d3f4da4521 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.894372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e906eb38-119b-4591-aa52-87d3f4da4521" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.894372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e906eb38-119b-4591-aa52-87d3f4da4521" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.896845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e906eb38-119b-4591-aa52-87d3f4da4521" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.896942] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e906eb38-119b-4591-aa52-87d3f4da4521',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.948690] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a9c2626-f236-4e95-8009-3b131bea6b54 [ 645.948690] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.948690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.948690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.948690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.948690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.948690] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a9c2626-f236-4e95-8009-3b131bea6b54 already deleted. [ 645.948690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a9c2626-f236-4e95-8009-3b131bea6b54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.398767] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e906eb38-119b-4591-aa52-87d3f4da4521 [ 646.398913] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.399021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.399465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.399465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.399465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.399465] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e906eb38-119b-4591-aa52-87d3f4da4521 already deleted. [ 646.399629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e906eb38-119b-4591-aa52-87d3f4da4521" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.053613] env[69358]: INFO networking_nsxv3.common.synchronization [None req-3021625c-a552-4324-839d-d768a66d1ce1 None None] Enqueued Resource ID: 6f70ec4d-643d-4733-b015-22c0c847a83e with Priority: HIGHEST for action port [ 647.053896] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f70ec4d-643d-4733-b015-22c0c847a83e with Priority: HIGHEST for action port [ 647.054216] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f70ec4d-643d-4733-b015-22c0c847a83e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.054334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f70ec4d-643d-4733-b015-22c0c847a83e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.054420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f70ec4d-643d-4733-b015-22c0c847a83e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.054858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f70ec4d-643d-4733-b015-22c0c847a83e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.054858] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f70ec4d-643d-4733-b015-22c0c847a83e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.116196] env[69358]: INFO networking_nsxv3.common.synchronization [None req-89aa1eeb-1edb-48cc-b004-d2d5115d0293 None None] Enqueued Resource ID: e107f0ed-10fb-435f-940e-6ac4bdee9582 with Priority: HIGHEST for action port [ 647.116196] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e107f0ed-10fb-435f-940e-6ac4bdee9582 with Priority: HIGHEST for action port [ 647.116196] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e107f0ed-10fb-435f-940e-6ac4bdee9582 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.116196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e107f0ed-10fb-435f-940e-6ac4bdee9582" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.116196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e107f0ed-10fb-435f-940e-6ac4bdee9582" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.118060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e107f0ed-10fb-435f-940e-6ac4bdee9582" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.118285] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e107f0ed-10fb-435f-940e-6ac4bdee9582',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.556896] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f70ec4d-643d-4733-b015-22c0c847a83e [ 647.557275] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.557949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.558083] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.558571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.558752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.559131] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f70ec4d-643d-4733-b015-22c0c847a83e already deleted. [ 647.559625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f70ec4d-643d-4733-b015-22c0c847a83e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.622180] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e107f0ed-10fb-435f-940e-6ac4bdee9582 [ 647.622405] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.622535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.622604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.622806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.622889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.622980] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e107f0ed-10fb-435f-940e-6ac4bdee9582 already deleted. [ 647.623071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e107f0ed-10fb-435f-940e-6ac4bdee9582" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.632409] env[69358]: INFO networking_nsxv3.common.synchronization [None req-72e430b8-81df-405c-8b7b-c44e63dabf45 None None] Enqueued Resource ID: 2e4bd35d-8682-41c7-b575-98ebc63ccdaf with Priority: HIGHEST for action port [ 647.632492] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4bd35d-8682-41c7-b575-98ebc63ccdaf with Priority: HIGHEST for action port [ 647.633071] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e4bd35d-8682-41c7-b575-98ebc63ccdaf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.633203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e4bd35d-8682-41c7-b575-98ebc63ccdaf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.633299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e4bd35d-8682-41c7-b575-98ebc63ccdaf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.633739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e4bd35d-8682-41c7-b575-98ebc63ccdaf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.633739] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e4bd35d-8682-41c7-b575-98ebc63ccdaf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.137985] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e4bd35d-8682-41c7-b575-98ebc63ccdaf [ 648.138265] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.138451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.138522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.138802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.139256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.139776] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e4bd35d-8682-41c7-b575-98ebc63ccdaf already deleted. [ 648.139776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e4bd35d-8682-41c7-b575-98ebc63ccdaf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.202305] env[69358]: INFO networking_nsxv3.common.synchronization [None req-fd507c03-87d8-4a54-a6b6-6d0a5f272fe2 None None] Enqueued Resource ID: d193905c-e4c5-493d-98d8-176123eec538 with Priority: HIGHEST for action port [ 648.202593] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d193905c-e4c5-493d-98d8-176123eec538 with Priority: HIGHEST for action port [ 648.203520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d193905c-e4c5-493d-98d8-176123eec538 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.203520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d193905c-e4c5-493d-98d8-176123eec538" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.203520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d193905c-e4c5-493d-98d8-176123eec538" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.203720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d193905c-e4c5-493d-98d8-176123eec538" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.203720] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d193905c-e4c5-493d-98d8-176123eec538',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.323410] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c656bdcb-25ef-49bc-8dd9-74685511843a None None] Enqueued Resource ID: 3cb9361b-fc23-44ce-a706-5bcb92aa1763 with Priority: HIGHEST for action port [ 648.323807] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb9361b-fc23-44ce-a706-5bcb92aa1763 with Priority: HIGHEST for action port [ 648.324352] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb9361b-fc23-44ce-a706-5bcb92aa1763 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.324352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb9361b-fc23-44ce-a706-5bcb92aa1763" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.324527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb9361b-fc23-44ce-a706-5bcb92aa1763" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.324651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb9361b-fc23-44ce-a706-5bcb92aa1763" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.324731] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb9361b-fc23-44ce-a706-5bcb92aa1763',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.708609] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d193905c-e4c5-493d-98d8-176123eec538 [ 648.708876] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.709200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.709200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.709335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.709393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.709488] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d193905c-e4c5-493d-98d8-176123eec538 already deleted. [ 648.712388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d193905c-e4c5-493d-98d8-176123eec538" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.829076] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cb9361b-fc23-44ce-a706-5bcb92aa1763 [ 648.829248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.829476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.829476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.831974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.831974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.831974] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cb9361b-fc23-44ce-a706-5bcb92aa1763 already deleted. [ 648.831974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb9361b-fc23-44ce-a706-5bcb92aa1763" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.351025] env[69358]: INFO networking_nsxv3.common.synchronization [None req-7973c36a-125c-4b89-ba5f-238e0aa4171a None None] Enqueued Resource ID: de2f5109-b549-4afa-ae3c-cb5a03771a26 with Priority: HIGHEST for action port [ 649.351025] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2f5109-b549-4afa-ae3c-cb5a03771a26 with Priority: HIGHEST for action port [ 649.351025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-de2f5109-b549-4afa-ae3c-cb5a03771a26 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.351025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de2f5109-b549-4afa-ae3c-cb5a03771a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.351025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de2f5109-b549-4afa-ae3c-cb5a03771a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.351025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de2f5109-b549-4afa-ae3c-cb5a03771a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.351641] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de2f5109-b549-4afa-ae3c-cb5a03771a26',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.856998] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de2f5109-b549-4afa-ae3c-cb5a03771a26 [ 649.856998] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.856998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.856998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.856998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.856998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.856998] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de2f5109-b549-4afa-ae3c-cb5a03771a26 already deleted. [ 649.856998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de2f5109-b549-4afa-ae3c-cb5a03771a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.858530] env[69358]: INFO networking_nsxv3.common.synchronization [None req-df9ef0b9-4756-4dcf-aaa5-e4326da24a9f None None] Enqueued Resource ID: b01e0f30-a666-4d75-abc3-56bf4d48cec0 with Priority: HIGHEST for action port [ 649.858711] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b01e0f30-a666-4d75-abc3-56bf4d48cec0 with Priority: HIGHEST for action port [ 649.858991] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b01e0f30-a666-4d75-abc3-56bf4d48cec0 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.859399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b01e0f30-a666-4d75-abc3-56bf4d48cec0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.859599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b01e0f30-a666-4d75-abc3-56bf4d48cec0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.859728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b01e0f30-a666-4d75-abc3-56bf4d48cec0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.859807] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b01e0f30-a666-4d75-abc3-56bf4d48cec0',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.118137] env[69358]: INFO networking_nsxv3.common.synchronization [None req-96776386-aa43-4820-945e-2793b264f3b3 None None] Enqueued Resource ID: d9d45105-dc4b-4bd2-99bb-516fc4f81e39 with Priority: HIGHEST for action port [ 650.120024] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d45105-dc4b-4bd2-99bb-516fc4f81e39 with Priority: HIGHEST for action port [ 650.120024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9d45105-dc4b-4bd2-99bb-516fc4f81e39 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.120024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9d45105-dc4b-4bd2-99bb-516fc4f81e39" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.120024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9d45105-dc4b-4bd2-99bb-516fc4f81e39" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.120024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9d45105-dc4b-4bd2-99bb-516fc4f81e39" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.120024] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9d45105-dc4b-4bd2-99bb-516fc4f81e39',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.361541] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b01e0f30-a666-4d75-abc3-56bf4d48cec0 [ 650.362061] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.362280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.362352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.362558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.362649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.362747] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b01e0f30-a666-4d75-abc3-56bf4d48cec0 already deleted. [ 650.362852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b01e0f30-a666-4d75-abc3-56bf4d48cec0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.381950] env[69358]: INFO networking_nsxv3.common.synchronization [None req-db085d6b-5c24-47e7-960d-51a164b747f2 None None] Enqueued Resource ID: 5b80c5fb-9d87-405e-bdb0-746aeca22f24 with Priority: HIGHEST for action port [ 650.383425] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b80c5fb-9d87-405e-bdb0-746aeca22f24 with Priority: HIGHEST for action port [ 650.383792] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b80c5fb-9d87-405e-bdb0-746aeca22f24 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.384253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b80c5fb-9d87-405e-bdb0-746aeca22f24" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.384474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b80c5fb-9d87-405e-bdb0-746aeca22f24" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.384686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b80c5fb-9d87-405e-bdb0-746aeca22f24" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.384800] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b80c5fb-9d87-405e-bdb0-746aeca22f24',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.624409] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9d45105-dc4b-4bd2-99bb-516fc4f81e39 [ 650.624704] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.624862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.624946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.625846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.625846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.625846] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9d45105-dc4b-4bd2-99bb-516fc4f81e39 already deleted. [ 650.625846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9d45105-dc4b-4bd2-99bb-516fc4f81e39" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.887564] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b80c5fb-9d87-405e-bdb0-746aeca22f24 [ 650.887822] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.888144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.888144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.888344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.888344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.888469] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b80c5fb-9d87-405e-bdb0-746aeca22f24 already deleted. [ 650.888524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b80c5fb-9d87-405e-bdb0-746aeca22f24" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.732692] env[69358]: INFO networking_nsxv3.common.synchronization [None req-09a643c3-1aa3-4cdb-b688-85e01f6f226d None None] Enqueued Resource ID: 7f25fdc3-c9f1-470d-93d8-02a750a859e9 with Priority: HIGHEST for action port [ 652.733224] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f25fdc3-c9f1-470d-93d8-02a750a859e9 with Priority: HIGHEST for action port [ 652.733512] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f25fdc3-c9f1-470d-93d8-02a750a859e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.733652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f25fdc3-c9f1-470d-93d8-02a750a859e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.733717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f25fdc3-c9f1-470d-93d8-02a750a859e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.734116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f25fdc3-c9f1-470d-93d8-02a750a859e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.737341] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f25fdc3-c9f1-470d-93d8-02a750a859e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.109746] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c6e762d9-7b64-4a69-a584-92fa466cf50b tempest-ServersTestJSON-737576159 tempest-ServersTestJSON-737576159-project-member] Enqueued Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_rules [ 653.109884] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_rules [ 653.110096] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-908f61ef-0a88-4419-a8be-58a9e18a05ea taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.110223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.110285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.110532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.110665] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.241388] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f25fdc3-c9f1-470d-93d8-02a750a859e9 [ 653.243111] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.243215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.243376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.243596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.244228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.244387] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f25fdc3-c9f1-470d-93d8-02a750a859e9 already deleted. [ 653.244513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f25fdc3-c9f1-470d-93d8-02a750a859e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.251621] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ea611e93-3316-4801-ac7d-ccaa84151f6b None None] Enqueued Resource ID: 5dcf66be-12f8-444d-9be8-3a996dce12a1 with Priority: HIGHEST for action port [ 653.256392] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dcf66be-12f8-444d-9be8-3a996dce12a1 with Priority: HIGHEST for action port [ 653.256392] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dcf66be-12f8-444d-9be8-3a996dce12a1 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.256392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dcf66be-12f8-444d-9be8-3a996dce12a1" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.256392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dcf66be-12f8-444d-9be8-3a996dce12a1" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.256392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dcf66be-12f8-444d-9be8-3a996dce12a1" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.256392] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dcf66be-12f8-444d-9be8-3a996dce12a1',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.313154] env[69358]: INFO networking_nsxv3.common.synchronization [None req-552e6ff8-bb9e-4cad-9907-1e31e204f1ba tempest-ServersTestJSON-737576159 tempest-ServersTestJSON-737576159-project-member] Enqueued Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_rules [ 653.316356] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_rules [ 653.317000] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-908f61ef-0a88-4419-a8be-58a9e18a05ea taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.317000] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.630871] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.631030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.631122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.631341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.631432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.631527] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea already deleted. [ 653.631624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.631800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.631987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.631987] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.761997] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5dcf66be-12f8-444d-9be8-3a996dce12a1 [ 653.762248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.762391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.762460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.762669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.762825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.762877] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5dcf66be-12f8-444d-9be8-3a996dce12a1 already deleted. [ 653.762915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dcf66be-12f8-444d-9be8-3a996dce12a1" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.905033] env[69358]: INFO networking_nsxv3.common.synchronization [None req-e5ee78ad-f41a-46f2-8685-a16796cbceca None None] Enqueued Resource ID: 944a4bf9-f435-4ec6-b156-693069a98a8d with Priority: HIGHEST for action port [ 653.905188] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 944a4bf9-f435-4ec6-b156-693069a98a8d with Priority: HIGHEST for action port [ 653.907362] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-944a4bf9-f435-4ec6-b156-693069a98a8d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.907362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-944a4bf9-f435-4ec6-b156-693069a98a8d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.907362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-944a4bf9-f435-4ec6-b156-693069a98a8d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.907362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-944a4bf9-f435-4ec6-b156-693069a98a8d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.907362] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944a4bf9-f435-4ec6-b156-693069a98a8d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.151684] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.151844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.151933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.152171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.152263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.154048] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea already deleted. [ 654.154118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.410092] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 944a4bf9-f435-4ec6-b156-693069a98a8d [ 654.410092] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.410092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.410092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.410315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.410347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.410425] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:944a4bf9-f435-4ec6-b156-693069a98a8d already deleted. [ 654.410522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-944a4bf9-f435-4ec6-b156-693069a98a8d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.006711] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ed043c99-9523-4143-84df-fabd61dab6d3 None None] Enqueued Resource ID: 4ee61be3-69fb-4d46-b6f3-63980e75403e with Priority: HIGHEST for action port [ 656.006711] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee61be3-69fb-4d46-b6f3-63980e75403e with Priority: HIGHEST for action port [ 656.006711] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ee61be3-69fb-4d46-b6f3-63980e75403e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.006711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ee61be3-69fb-4d46-b6f3-63980e75403e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.006711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ee61be3-69fb-4d46-b6f3-63980e75403e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.007527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ee61be3-69fb-4d46-b6f3-63980e75403e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.007659] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ee61be3-69fb-4d46-b6f3-63980e75403e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.016159] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c56e6a7d-d2ec-4f6b-b626-3e860e6e4671 None None] Enqueued Resource ID: 37477c37-c799-4a62-98cc-9bce21392cf1 with Priority: HIGHEST for action port [ 656.016731] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37477c37-c799-4a62-98cc-9bce21392cf1 with Priority: HIGHEST for action port [ 656.016944] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-37477c37-c799-4a62-98cc-9bce21392cf1 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.017120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37477c37-c799-4a62-98cc-9bce21392cf1" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.017206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37477c37-c799-4a62-98cc-9bce21392cf1" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.017460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37477c37-c799-4a62-98cc-9bce21392cf1" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.017685] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37477c37-c799-4a62-98cc-9bce21392cf1',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.512399] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ee61be3-69fb-4d46-b6f3-63980e75403e [ 656.512693] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.512785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.512875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.513178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.513641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.513641] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ee61be3-69fb-4d46-b6f3-63980e75403e already deleted. [ 656.513641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ee61be3-69fb-4d46-b6f3-63980e75403e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.520042] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37477c37-c799-4a62-98cc-9bce21392cf1 [ 656.520248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.520539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.520539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.520712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.520824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.521234] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37477c37-c799-4a62-98cc-9bce21392cf1 already deleted. [ 656.521234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37477c37-c799-4a62-98cc-9bce21392cf1" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.719625] env[69358]: INFO networking_nsxv3.common.synchronization [None req-fcf1ae12-1c1f-4c58-9af1-9796f4902997 None None] Enqueued Resource ID: b275a8cf-a759-41dd-9e3a-a89a2c0a7936 with Priority: HIGHEST for action port [ 656.720864] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b275a8cf-a759-41dd-9e3a-a89a2c0a7936 with Priority: HIGHEST for action port [ 656.722017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b275a8cf-a759-41dd-9e3a-a89a2c0a7936 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.722017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b275a8cf-a759-41dd-9e3a-a89a2c0a7936" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.722017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b275a8cf-a759-41dd-9e3a-a89a2c0a7936" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.722017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b275a8cf-a759-41dd-9e3a-a89a2c0a7936" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.722318] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b275a8cf-a759-41dd-9e3a-a89a2c0a7936',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.226811] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b275a8cf-a759-41dd-9e3a-a89a2c0a7936 [ 657.227125] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.227286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.227366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.227527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.227647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.227842] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b275a8cf-a759-41dd-9e3a-a89a2c0a7936 already deleted. [ 657.227842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b275a8cf-a759-41dd-9e3a-a89a2c0a7936" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.369480] env[69358]: INFO networking_nsxv3.common.synchronization [None req-d6057bb6-4fec-4a51-b6d1-cc8d5c2b7ae5 None None] Enqueued Resource ID: a25adba9-6420-4675-bba3-118c2308af64 with Priority: HIGHEST for action port [ 657.369480] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25adba9-6420-4675-bba3-118c2308af64 with Priority: HIGHEST for action port [ 657.369875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a25adba9-6420-4675-bba3-118c2308af64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.370119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a25adba9-6420-4675-bba3-118c2308af64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.370119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a25adba9-6420-4675-bba3-118c2308af64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.370319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a25adba9-6420-4675-bba3-118c2308af64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.370398] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a25adba9-6420-4675-bba3-118c2308af64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.878917] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a25adba9-6420-4675-bba3-118c2308af64 [ 657.878917] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.878917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.878917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.880030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.880030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.880030] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a25adba9-6420-4675-bba3-118c2308af64 already deleted. [ 657.880232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a25adba9-6420-4675-bba3-118c2308af64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.048049] env[69358]: INFO networking_nsxv3.common.synchronization [None req-d190e481-048a-4d6b-92a7-38b312d4b566 None None] Enqueued Resource ID: b17174df-7f70-4b4c-aecd-07f436f9e6e6 with Priority: HIGHEST for action port [ 658.048347] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17174df-7f70-4b4c-aecd-07f436f9e6e6 with Priority: HIGHEST for action port [ 658.048995] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b17174df-7f70-4b4c-aecd-07f436f9e6e6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.049193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b17174df-7f70-4b4c-aecd-07f436f9e6e6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.049284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b17174df-7f70-4b4c-aecd-07f436f9e6e6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.049549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b17174df-7f70-4b4c-aecd-07f436f9e6e6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.049659] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b17174df-7f70-4b4c-aecd-07f436f9e6e6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.551480] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b17174df-7f70-4b4c-aecd-07f436f9e6e6 [ 658.551743] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.552014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.552014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.552158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.552261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.553468] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b17174df-7f70-4b4c-aecd-07f436f9e6e6 already deleted. [ 658.553681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b17174df-7f70-4b4c-aecd-07f436f9e6e6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.724200] env[69358]: INFO networking_nsxv3.common.synchronization [None req-b3096233-a346-4214-a168-1290c7c3e738 None None] Enqueued Resource ID: 881b4820-6849-43af-8302-8d770e77ae6a with Priority: HIGHEST for action port [ 659.724907] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881b4820-6849-43af-8302-8d770e77ae6a with Priority: HIGHEST for action port [ 659.725171] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-881b4820-6849-43af-8302-8d770e77ae6a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.725298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-881b4820-6849-43af-8302-8d770e77ae6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.728205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-881b4820-6849-43af-8302-8d770e77ae6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.728205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-881b4820-6849-43af-8302-8d770e77ae6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.728205] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('881b4820-6849-43af-8302-8d770e77ae6a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.896419] env[69358]: INFO networking_nsxv3.common.synchronization [None req-1bc1ddf2-2a69-4363-87c5-c154ff0a86f5 None None] Enqueued Resource ID: 321a780a-0772-47a9-93b6-860c9a222ab9 with Priority: HIGHEST for action port [ 659.897193] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321a780a-0772-47a9-93b6-860c9a222ab9 with Priority: HIGHEST for action port [ 659.898193] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-321a780a-0772-47a9-93b6-860c9a222ab9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.898193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-321a780a-0772-47a9-93b6-860c9a222ab9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.898193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-321a780a-0772-47a9-93b6-860c9a222ab9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.899440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-321a780a-0772-47a9-93b6-860c9a222ab9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.899440] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('321a780a-0772-47a9-93b6-860c9a222ab9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.234842] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 881b4820-6849-43af-8302-8d770e77ae6a [ 660.234842] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.234842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.234842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.234842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.234842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.234842] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:881b4820-6849-43af-8302-8d770e77ae6a already deleted. [ 660.234842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-881b4820-6849-43af-8302-8d770e77ae6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.402531] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 321a780a-0772-47a9-93b6-860c9a222ab9 [ 660.402830] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.402946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.402946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.403475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.403475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.403475] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:321a780a-0772-47a9-93b6-860c9a222ab9 already deleted. [ 660.403475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-321a780a-0772-47a9-93b6-860c9a222ab9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.476013] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.476362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.476362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.476513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.477642] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.696136] env[69358]: INFO networking_nsxv3.common.synchronization [req-8f1ba9b2-6d3c-41c9-a3f7-b156433db931 req-e88209f8-90ae-488b-9e7f-7eac745b324e tempest-ImagesOneServerNegativeTestJSON-962105235 tempest-ImagesOneServerNegativeTestJSON-962105235-project-member] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 660.696136] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 660.696136] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.697596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.697596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.702707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.702707] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.702707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.702707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.702963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.702963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.703094] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.981333] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.034744] env[69358]: INFO networking_nsxv3.common.synchronization [None req-62d70a2b-29eb-46f7-b44b-07e5dcb70963 None None] Enqueued Resource ID: d714c290-4ffd-418e-8518-04f8a27bb28e with Priority: HIGHEST for action port [ 661.034744] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d714c290-4ffd-418e-8518-04f8a27bb28e with Priority: HIGHEST for action port [ 661.035265] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d714c290-4ffd-418e-8518-04f8a27bb28e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.035388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d714c290-4ffd-418e-8518-04f8a27bb28e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.035455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d714c290-4ffd-418e-8518-04f8a27bb28e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.035700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d714c290-4ffd-418e-8518-04f8a27bb28e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.035780] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d714c290-4ffd-418e-8518-04f8a27bb28e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.208520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.208671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.208820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.209307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.209307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.209307] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.210486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.210486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.210486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.210486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.210486] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 already deleted. [ 661.211911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.484688] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.542198] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d714c290-4ffd-418e-8518-04f8a27bb28e [ 661.542198] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.542198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.542198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.542198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.542198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.542198] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d714c290-4ffd-418e-8518-04f8a27bb28e already deleted. [ 661.542198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d714c290-4ffd-418e-8518-04f8a27bb28e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.986922] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 661.986922] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 662.636322] env[69358]: INFO networking_nsxv3.common.synchronization [None req-4ea225a3-78b3-4a02-ab98-af3c3d25abb0 None None] Enqueued Resource ID: c8780c14-8464-465b-b83b-18c168c9b886 with Priority: HIGHEST for action port [ 662.636322] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8780c14-8464-465b-b83b-18c168c9b886 with Priority: HIGHEST for action port [ 662.636322] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8780c14-8464-465b-b83b-18c168c9b886 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.636322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8780c14-8464-465b-b83b-18c168c9b886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.636322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8780c14-8464-465b-b83b-18c168c9b886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.636322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8780c14-8464-465b-b83b-18c168c9b886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.636322] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8780c14-8464-465b-b83b-18c168c9b886',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.737395] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.737487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.737487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.737738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.758110] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 662.758110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.759780] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 662.780874] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.781044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.781093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.781337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.781447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.781627] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 662.781693] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 662.781765] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 662.804087] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.804383] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.804383] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.804561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.804661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.804770] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 662.825850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.825850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.825850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.826089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.826294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.826294] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 662.844194] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.844358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.844453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.844784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.844859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.844904] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 662.844975] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 662.845081] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 662.862275] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.864347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.864347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.864347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.864347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.864347] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 662.864347] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 662.864347] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 662.885086] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.885086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.885086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.885291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.885356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.885519] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 662.885609] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 662.885779] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 662.885779] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 662.885868] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 662.885896] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 662.886022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 662.886305] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 662.886590] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 662.886590] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 662.910158] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.910158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.910158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.910158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.910158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.910158] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 662.927902] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.928102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.928176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.930135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.930135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.942752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.135780] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8780c14-8464-465b-b83b-18c168c9b886 [ 663.136098] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.136098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.136098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.136446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.136446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.136697] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8780c14-8464-465b-b83b-18c168c9b886 already deleted. [ 663.136697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8780c14-8464-465b-b83b-18c168c9b886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.251947] env[69358]: INFO networking_nsxv3.common.synchronization [None req-05f7c730-1c66-41bf-8781-88ac7414005a tempest-ServersWithSpecificFlavorTestJSON-1142878247 tempest-ServersWithSpecificFlavorTestJSON-1142878247-project-member] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_rules [ 663.252559] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_rules [ 663.254196] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.254196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.254196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.254196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.254196] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.779577] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.780455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.780455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.780701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.780701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.780822] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b already deleted. [ 663.781085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.883267] env[69358]: INFO networking_nsxv3.common.synchronization [None req-7507e2a3-4b2e-4d3b-82e8-6f8cccf8ec59 None None] Enqueued Resource ID: 49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5 with Priority: HIGHEST for action port [ 663.884451] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5 with Priority: HIGHEST for action port [ 663.884451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.884659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.884659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.885226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.885312] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.337348] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.337676] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.337734] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.338327] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.338676] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.338893] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.338979] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.339248] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.340153] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.340527] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.340657] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.340775] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.340890] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.341640] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.341640] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.341640] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.364575] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.364575] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 664.364575] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.364575] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.364853] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4464d128-ef50-478c-a2bb-18ad15f4e3d4 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.366346] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4464d128-ef50-478c-a2bb-18ad15f4e3d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.366346] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4464d128-ef50-478c-a2bb-18ad15f4e3d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.366346] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4464d128-ef50-478c-a2bb-18ad15f4e3d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.366346] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4464d128-ef50-478c-a2bb-18ad15f4e3d4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.387428] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5 [ 664.387729] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.391024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.391024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.391024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.391024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.391024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5 already deleted. [ 664.391024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49eb0bb5-9aa3-4f6d-a905-3f48355c5ce5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.477888] env[69358]: INFO networking_nsxv3.common.synchronization [req-8e2fbfbf-24d2-4bfb-b5b6-5092217f3087 req-0c46c678-f7a6-48ab-b8cd-50eb215bc654 tempest-DeleteServersAdminTestJSON-390053105 tempest-DeleteServersAdminTestJSON-390053105-project-member] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 664.477888] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 664.483273] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.483273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.483273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.483273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.483273] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.483273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.483273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.483273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.483273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.483273] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.607712] env[69358]: INFO networking_nsxv3.common.synchronization [None req-cbb28403-93de-47dc-94f4-6ecc34e5612f tempest-ServersWithSpecificFlavorTestJSON-1142878247 tempest-ServersWithSpecificFlavorTestJSON-1142878247-project-member] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_rules [ 664.608629] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_rules [ 664.609428] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.609428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.609428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.609603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.609639] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.729174] env[69358]: INFO networking_nsxv3.common.synchronization [None req-4c07f29d-d425-4cc2-8289-fde5f8b136aa None None] Enqueued Resource ID: 3e42c3bf-b1a1-4058-8237-afb2da74e83a with Priority: HIGHEST for action port [ 664.729174] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e42c3bf-b1a1-4058-8237-afb2da74e83a with Priority: HIGHEST for action port [ 664.729174] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e42c3bf-b1a1-4058-8237-afb2da74e83a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.729361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e42c3bf-b1a1-4058-8237-afb2da74e83a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.729361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e42c3bf-b1a1-4058-8237-afb2da74e83a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.729644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e42c3bf-b1a1-4058-8237-afb2da74e83a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.729691] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e42c3bf-b1a1-4058-8237-afb2da74e83a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.874034] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.874034] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.874213] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.874393] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.874552] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.879069] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 4464d128-ef50-478c-a2bb-18ad15f4e3d4 not found, creating... [ 664.879069] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.879069] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.879069] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.879336] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.879336] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.879800] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.879887] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.880021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.880274] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.880438] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.880586] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4464d128-ef50-478c-a2bb-18ad15f4e3d4 is going to be created. [ 664.909852] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.910359] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.910359] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.910431] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.910702] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.912955] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4464d128-ef50-478c-a2bb-18ad15f4e3d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.984753] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.984923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.985014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.985268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.985357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.985533] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.985642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.985708] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.985835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.985910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.986000] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 already deleted. [ 664.986100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.132695] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.132695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.132695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.132695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.132936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.133051] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b already deleted. [ 665.133138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.235257] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e42c3bf-b1a1-4058-8237-afb2da74e83a [ 665.235257] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.235352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.238887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.239159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.239253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.239357] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e42c3bf-b1a1-4058-8237-afb2da74e83a already deleted. [ 665.239448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e42c3bf-b1a1-4058-8237-afb2da74e83a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.380028] env[69358]: INFO networking_nsxv3.common.synchronization [req-18e34027-4c6f-4425-8f4a-7e6dceba071e req-ca798710-0195-45de-99ca-2195e3adfb11 tempest-MigrationsAdminTest-1296336123 tempest-MigrationsAdminTest-1296336123-project-member] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 665.380028] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 665.380028] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.380028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.380028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.380028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.382538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.382538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.382538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.382538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.382670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.382670] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.808982] env[69358]: INFO networking_nsxv3.common.synchronization [None req-16469507-07c6-4398-a27f-8bd6c2939ae0 None None] Enqueued Resource ID: 5b109bcb-c476-4266-a17c-938d4e12ff7e with Priority: HIGHEST for action port [ 665.809268] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b109bcb-c476-4266-a17c-938d4e12ff7e with Priority: HIGHEST for action port [ 665.810108] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b109bcb-c476-4266-a17c-938d4e12ff7e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.812018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b109bcb-c476-4266-a17c-938d4e12ff7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.812018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b109bcb-c476-4266-a17c-938d4e12ff7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.812018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b109bcb-c476-4266-a17c-938d4e12ff7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.812018] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b109bcb-c476-4266-a17c-938d4e12ff7e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.886857] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.886857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.886857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.887225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.887343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.887501] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.887569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.887621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.887776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.887849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.887970] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 already deleted. [ 665.888121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.951856] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.954138] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.954138] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.957305] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.957305] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.957305] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.957305] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.957305] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.957787] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.958255] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.958255] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.958364] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.958682] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.958682] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.959077] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.959077] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.981681] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.982136] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.982314] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.982500] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.982837] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-03594f78-43eb-4a0a-9bca-b215cd964912 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.983016] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-03594f78-43eb-4a0a-9bca-b215cd964912" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.983134] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-03594f78-43eb-4a0a-9bca-b215cd964912" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.983452] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-03594f78-43eb-4a0a-9bca-b215cd964912" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.983595] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03594f78-43eb-4a0a-9bca-b215cd964912',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.314421] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b109bcb-c476-4266-a17c-938d4e12ff7e [ 666.314645] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.314864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.314864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.315074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.315146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.315240] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b109bcb-c476-4266-a17c-938d4e12ff7e already deleted. [ 666.315362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b109bcb-c476-4266-a17c-938d4e12ff7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.415697] env[69358]: INFO networking_nsxv3.common.synchronization [None req-958d6847-eb73-47ec-b053-770c9c151098 None None] Enqueued Resource ID: 8b248654-969b-48f7-8c81-4f6d61d53b34 with Priority: HIGHEST for action port [ 666.416193] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b248654-969b-48f7-8c81-4f6d61d53b34 with Priority: HIGHEST for action port [ 666.416466] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b248654-969b-48f7-8c81-4f6d61d53b34 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.416590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b248654-969b-48f7-8c81-4f6d61d53b34" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.416751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b248654-969b-48f7-8c81-4f6d61d53b34" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.416936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b248654-969b-48f7-8c81-4f6d61d53b34" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.417014] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b248654-969b-48f7-8c81-4f6d61d53b34',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.487080] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.487498] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.487498] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.487733] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.487818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.487911] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 03594f78-43eb-4a0a-9bca-b215cd964912 not found, creating... [ 666.488328] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.488412] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.488447] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.488710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.488876] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.489173] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.489275] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.489407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.489578] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.489719] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.489857] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 03594f78-43eb-4a0a-9bca-b215cd964912 is going to be created. [ 666.510306] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.510528] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.510677] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.510946] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.511199] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.511444] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-03594f78-43eb-4a0a-9bca-b215cd964912" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.775018] env[69358]: INFO networking_nsxv3.common.synchronization [req-8f1ba9b2-6d3c-41c9-a3f7-b156433db931 req-729c5279-921b-42db-a9c5-b126097178a5 service nova] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_rules [ 666.775018] env[69358]: INFO networking_nsxv3.common.synchronization [req-8f1ba9b2-6d3c-41c9-a3f7-b156433db931 req-729c5279-921b-42db-a9c5-b126097178a5 service nova] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 666.775018] env[69358]: INFO networking_nsxv3.common.synchronization [req-8f1ba9b2-6d3c-41c9-a3f7-b156433db931 req-729c5279-921b-42db-a9c5-b126097178a5 service nova] Enqueued Resource ID: 4464d128-ef50-478c-a2bb-18ad15f4e3d4 with Priority: HIGHEST for action port [ 666.775018] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_rules [ 666.775018] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 666.775018] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4464d128-ef50-478c-a2bb-18ad15f4e3d4 with Priority: HIGHEST for action port [ 666.775018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.775018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.775018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.775018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.775403] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.775979] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.777268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.777268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.777268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.777268] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.777268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.777268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.777268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.777268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.777268] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.778367] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4464d128-ef50-478c-a2bb-18ad15f4e3d4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.780122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4464d128-ef50-478c-a2bb-18ad15f4e3d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.780122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4464d128-ef50-478c-a2bb-18ad15f4e3d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.780122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4464d128-ef50-478c-a2bb-18ad15f4e3d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.780122] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4464d128-ef50-478c-a2bb-18ad15f4e3d4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.799295] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.799776] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.799776] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.800031] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.800452] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.800452] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.800641] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.800771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.800909] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.801341] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.801341] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.801341] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.801463] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.801564] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.801666] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.801855] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.820888] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.821123] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 666.821231] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.821407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.821720] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e82dae0f-c81c-4db6-8ba4-5526cacff065 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.821896] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e82dae0f-c81c-4db6-8ba4-5526cacff065" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.822117] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e82dae0f-c81c-4db6-8ba4-5526cacff065" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.822342] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e82dae0f-c81c-4db6-8ba4-5526cacff065" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.822483] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e82dae0f-c81c-4db6-8ba4-5526cacff065',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.919952] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b248654-969b-48f7-8c81-4f6d61d53b34 [ 666.920374] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.920514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.920585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.920822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.921448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.921507] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b248654-969b-48f7-8c81-4f6d61d53b34 already deleted. [ 666.921567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b248654-969b-48f7-8c81-4f6d61d53b34" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.281018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.281205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.308180] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4464d128-ef50-478c-a2bb-18ad15f4e3d4 with status ACTIVE [ 667.308459] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.308628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.308628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.308815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.309292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.309292] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.309292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.309292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.310488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.310488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.310488] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.310488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.310488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.310488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.310488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.310488] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4464d128-ef50-478c-a2bb-18ad15f4e3d4 is going to be updated. [ 667.312235] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.327175] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.327175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.327175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.327175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.327175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.327175] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e82dae0f-c81c-4db6-8ba4-5526cacff065 not found, creating... [ 667.327175] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.327175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.327175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.327175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.327175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.327766] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.327766] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.327766] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.327766] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.329735] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.330103] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e82dae0f-c81c-4db6-8ba4-5526cacff065 is going to be created. [ 667.336248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.341512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.341512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.341512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.341512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.341512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4464d128-ef50-478c-a2bb-18ad15f4e3d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.364158] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.364158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.364158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.364158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.364158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.364158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e82dae0f-c81c-4db6-8ba4-5526cacff065" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.633756] env[69358]: INFO networking_nsxv3.common.synchronization [req-1c81f306-9774-4abf-b014-d03dfc16b680 req-58c62ead-fbcf-4bb6-b637-2c0baad7bb54 tempest-ServersTestJSON-737576159 tempest-ServersTestJSON-737576159-project-member] Enqueued Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_members [ 667.634617] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_members [ 667.637260] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-908f61ef-0a88-4419-a8be-58a9e18a05ea taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.637408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.637480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.637746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.637931] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.638257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.638257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.638257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.638392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.638424] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.782913] env[69358]: INFO networking_nsxv3.common.synchronization [None req-3116e97f-2be1-4325-a909-b9afcf3f3c05 None None] Enqueued Resource ID: 645bf45b-4283-43b2-ace0-6c609705a66f with Priority: HIGHEST for action port [ 667.783262] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645bf45b-4283-43b2-ace0-6c609705a66f with Priority: HIGHEST for action port [ 667.783915] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-645bf45b-4283-43b2-ace0-6c609705a66f taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.784118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-645bf45b-4283-43b2-ace0-6c609705a66f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.784381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-645bf45b-4283-43b2-ace0-6c609705a66f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.785269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-645bf45b-4283-43b2-ace0-6c609705a66f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.785269] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645bf45b-4283-43b2-ace0-6c609705a66f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.821639] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.834594] env[69358]: INFO networking_nsxv3.common.synchronization [None req-69a39e5e-fd6f-42a0-977c-2d1cc65cb5b0 None None] Enqueued Resource ID: 0fa69a68-1f2c-4824-b011-7ca2a9bc10d7 with Priority: HIGHEST for action port [ 667.835208] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fa69a68-1f2c-4824-b011-7ca2a9bc10d7 with Priority: HIGHEST for action port [ 667.835847] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fa69a68-1f2c-4824-b011-7ca2a9bc10d7 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.835954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fa69a68-1f2c-4824-b011-7ca2a9bc10d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.835996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fa69a68-1f2c-4824-b011-7ca2a9bc10d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.838067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fa69a68-1f2c-4824-b011-7ca2a9bc10d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.838154] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fa69a68-1f2c-4824-b011-7ca2a9bc10d7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.141215] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.141297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.141342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.141536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.141634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.141812] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.141909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.141971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.142176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.142217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.142688] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea already deleted. [ 668.142688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.255558] env[69358]: INFO networking_nsxv3.common.synchronization [req-8e2fbfbf-24d2-4bfb-b5b6-5092217f3087 req-0a234283-9205-4a0b-8275-11e59c8d4ce3 service nova] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_rules [ 668.255728] env[69358]: INFO networking_nsxv3.common.synchronization [req-8e2fbfbf-24d2-4bfb-b5b6-5092217f3087 req-0a234283-9205-4a0b-8275-11e59c8d4ce3 service nova] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 668.255865] env[69358]: INFO networking_nsxv3.common.synchronization [req-8e2fbfbf-24d2-4bfb-b5b6-5092217f3087 req-0a234283-9205-4a0b-8275-11e59c8d4ce3 service nova] Enqueued Resource ID: 03594f78-43eb-4a0a-9bca-b215cd964912 with Priority: HIGHEST for action port [ 668.256471] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_rules [ 668.257838] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 668.258351] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03594f78-43eb-4a0a-9bca-b215cd964912 with Priority: HIGHEST for action port [ 668.258351] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.258905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.258905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.258905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.259305] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.260962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.261163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.261163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.261686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.261854] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.261980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.262118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.262246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.262350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.262449] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.263674] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-03594f78-43eb-4a0a-9bca-b215cd964912 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.263754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03594f78-43eb-4a0a-9bca-b215cd964912" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.264166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03594f78-43eb-4a0a-9bca-b215cd964912" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.264166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03594f78-43eb-4a0a-9bca-b215cd964912" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.264166] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03594f78-43eb-4a0a-9bca-b215cd964912',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.291801] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 645bf45b-4283-43b2-ace0-6c609705a66f [ 668.292096] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.292236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.292301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.292530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.293269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.296029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:645bf45b-4283-43b2-ace0-6c609705a66f already deleted. [ 668.296029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-645bf45b-4283-43b2-ace0-6c609705a66f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.324727] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.324901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.325070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.325204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.325296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.325393] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be created. [ 668.342001] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fa69a68-1f2c-4824-b011-7ca2a9bc10d7 [ 668.342001] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.342001] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.342001] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.343170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.343170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.343170] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fa69a68-1f2c-4824-b011-7ca2a9bc10d7 already deleted. [ 668.343170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fa69a68-1f2c-4824-b011-7ca2a9bc10d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.359437] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.359437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.359437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.359437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.359437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.370239] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: UNINITIALIZED for 2s [ 668.428184] env[69358]: INFO networking_nsxv3.common.synchronization [None req-8b22b04d-70e9-4faf-a1fd-ef8d49095acb tempest-VolumesAssistedSnapshotsTest-737708639 tempest-VolumesAssistedSnapshotsTest-737708639-project-member] Enqueued Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_rules [ 668.429358] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_rules [ 668.430673] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3790264b-87dd-4660-b7c5-8d4dc98f1500 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.430796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.430861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.431885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.431977] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.723766] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ab8f65ce-a37d-4128-a32f-8e09039ab606 None None] Enqueued Resource ID: b8728ccb-cbda-48c5-92fa-424cda947242 with Priority: HIGHEST for action port [ 668.724154] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8728ccb-cbda-48c5-92fa-424cda947242 with Priority: HIGHEST for action port [ 668.724549] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8728ccb-cbda-48c5-92fa-424cda947242 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.724665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8728ccb-cbda-48c5-92fa-424cda947242" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.724746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8728ccb-cbda-48c5-92fa-424cda947242" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.725026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8728ccb-cbda-48c5-92fa-424cda947242" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.725066] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8728ccb-cbda-48c5-92fa-424cda947242',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.765343] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.765488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.767269] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.767940] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03594f78-43eb-4a0a-9bca-b215cd964912 with status ACTIVE [ 668.767940] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.767940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.767940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.768163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.768249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.768418] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.768525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.768612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.768725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.768797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.768970] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.769082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.769172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.769646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.769646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.769646] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03594f78-43eb-4a0a-9bca-b215cd964912 is going to be updated. [ 668.790217] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.790344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.790344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.790727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.790727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.790828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03594f78-43eb-4a0a-9bca-b215cd964912" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.952879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.952879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.952879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.952879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.952879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.952879] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 already deleted. [ 668.952879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.955786] env[69358]: INFO networking_nsxv3.common.synchronization [None req-782cfc97-380d-4bd5-8862-40a51b28fc2d tempest-VolumesAssistedSnapshotsTest-737708639 tempest-VolumesAssistedSnapshotsTest-737708639-project-member] Enqueued Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_rules [ 668.956408] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_rules [ 668.957283] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3790264b-87dd-4660-b7c5-8d4dc98f1500 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.957852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.958022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.958370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.958697] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.227585] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8728ccb-cbda-48c5-92fa-424cda947242 [ 669.228864] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.228864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.228864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.228864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.228864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.228864] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8728ccb-cbda-48c5-92fa-424cda947242 already deleted. [ 669.228864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8728ccb-cbda-48c5-92fa-424cda947242" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.271336] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.286913] env[69358]: INFO networking_nsxv3.common.synchronization [req-9cd551f2-edf4-4e98-9c52-fc5fa857928b req-bc8e1068-6e9b-4208-9bda-a6742eda158b tempest-ServersAdminTestJSON-846589263 tempest-ServersAdminTestJSON-846589263-project-member] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 669.286913] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 669.286913] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.286913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.286913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.288523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.290566] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.290566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.290566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.290566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.290566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.290566] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.457593] env[69358]: INFO networking_nsxv3.common.synchronization [req-18e34027-4c6f-4425-8f4a-7e6dceba071e req-b594b2ac-acf9-489b-a68e-b2638138308d service nova] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_rules [ 669.457768] env[69358]: INFO networking_nsxv3.common.synchronization [req-18e34027-4c6f-4425-8f4a-7e6dceba071e req-b594b2ac-acf9-489b-a68e-b2638138308d service nova] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 669.457937] env[69358]: INFO networking_nsxv3.common.synchronization [req-18e34027-4c6f-4425-8f4a-7e6dceba071e req-b594b2ac-acf9-489b-a68e-b2638138308d service nova] Enqueued Resource ID: e82dae0f-c81c-4db6-8ba4-5526cacff065 with Priority: HIGHEST for action port [ 669.458141] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_rules [ 669.458714] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 669.458714] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e82dae0f-c81c-4db6-8ba4-5526cacff065 with Priority: HIGHEST for action port [ 669.458866] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.458989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.462788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.463757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.463757] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.466514] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.466514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.466514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.466514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.466706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.466910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.466910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.467126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.467232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.467585] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.468798] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e82dae0f-c81c-4db6-8ba4-5526cacff065 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.468943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e82dae0f-c81c-4db6-8ba4-5526cacff065" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.469060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e82dae0f-c81c-4db6-8ba4-5526cacff065" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.469264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e82dae0f-c81c-4db6-8ba4-5526cacff065" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.469367] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e82dae0f-c81c-4db6-8ba4-5526cacff065',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.489961] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.490269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.490381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.491050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.491189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.492605] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 already deleted. [ 669.492605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.774422] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.774690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.774839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.775101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.775251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.775408] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 is going to be created. [ 669.791964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.792138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.792194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.792415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.792516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.792722] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.792825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.792885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.793052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.793133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.793234] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 already deleted. [ 669.793296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.798946] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.799207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.799303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.799605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.799679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.810158] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: UNINITIALIZED for 2s [ 669.972791] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.972791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.972791] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.974554] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e82dae0f-c81c-4db6-8ba4-5526cacff065 with status ACTIVE [ 669.974554] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.974554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.974554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.974554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.974554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.974554] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.974554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.974554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.974927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.974927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.975174] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.975959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.975959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.977041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.977041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.977041] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e82dae0f-c81c-4db6-8ba4-5526cacff065 is going to be updated. [ 669.996951] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.996951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.996951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.996951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.997222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.997222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e82dae0f-c81c-4db6-8ba4-5526cacff065" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.001028] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.001028] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-88" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.001028] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-88" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.001334] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-88" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.001607] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.001772] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.001892] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.002133] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.002298] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.002568] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.002695] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.002806] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.003009] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.003049] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.003702] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.004108] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.027106] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.027292] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 670.027430] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.031023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-88" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.031023] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.031023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.031023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.031023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.031023] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d4adce7-6b21-4372-aa4d-025ef83f4cd6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.089886] env[69358]: INFO networking_nsxv3.common.synchronization [None req-99f93b16-c7c9-4c76-af05-adec2fdc037d None None] Enqueued Resource ID: aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9 with Priority: HIGHEST for action port [ 670.091529] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9 with Priority: HIGHEST for action port [ 670.091848] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.091977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.094422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.094422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.094422] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.380371] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 670.380679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.380759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.380969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.381169] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.381288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.381389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.381496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.381574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.381663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.381756] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.483618] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.484704] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.484951] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.487797] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.487797] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.487797] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.487797] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.487797] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.487797] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.487797] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.488270] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.488270] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.488270] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.488270] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.488612] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.488612] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.488612] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.506220] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.506378] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 670.506536] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.506719] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.507059] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-76e41a36-0955-4bd1-83ad-4fe910c61c6b taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.509085] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-76e41a36-0955-4bd1-83ad-4fe910c61c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.509085] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-76e41a36-0955-4bd1-83ad-4fe910c61c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.509085] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-76e41a36-0955-4bd1-83ad-4fe910c61c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.509085] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76e41a36-0955-4bd1-83ad-4fe910c61c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.531597] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.531597] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.531597] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.531921] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.532076] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.532237] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 8d4adce7-6b21-4372-aa4d-025ef83f4cd6 not found, creating... [ 670.533300] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.533300] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.533300] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.533300] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.533300] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.533520] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.533520] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.534047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.534047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.534047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.534191] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 8d4adce7-6b21-4372-aa4d-025ef83f4cd6 is going to be created. [ 670.555732] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.555732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.555732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.555732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.555732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.555732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.595830] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9 [ 670.596397] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.596546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.596613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.596822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.596907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.597171] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9 already deleted. [ 670.597171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aceee3a6-0cf4-41e1-9e4f-f51edbab6ae9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.837099] env[69358]: INFO networking_nsxv3.common.synchronization [None req-f2f9cc2d-8afd-4d34-98ce-89d5e5cc5194 None None] Enqueued Resource ID: 4f823533-7169-4a40-893f-35d2eea3d60c with Priority: HIGHEST for action port [ 670.837416] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f823533-7169-4a40-893f-35d2eea3d60c with Priority: HIGHEST for action port [ 670.837970] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f823533-7169-4a40-893f-35d2eea3d60c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.838106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f823533-7169-4a40-893f-35d2eea3d60c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.838170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f823533-7169-4a40-893f-35d2eea3d60c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.838426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f823533-7169-4a40-893f-35d2eea3d60c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.838510] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f823533-7169-4a40-893f-35d2eea3d60c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.886350] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.886350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.886350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.886350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.886350] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.886350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.886350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.886625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.886625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.886684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.886802] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.886869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.886927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.887106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.887251] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.887347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.887407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.887543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.887616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.887695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.887784] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.991726] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.991898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.991969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.992214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.992338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.992400] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be created. [ 671.014540] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.014830] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.015031] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.015478] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.016279] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.016279] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 76e41a36-0955-4bd1-83ad-4fe910c61c6b not found, creating... [ 671.016279] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.016458] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.016671] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.016965] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.017368] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.018008] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.018357] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.018536] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.018790] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.018964] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.019367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 76e41a36-0955-4bd1-83ad-4fe910c61c6b is going to be created. [ 671.049604] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.049819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.049941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.050200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.050407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.058154] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.058154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.058154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.058154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.060145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.060145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-76e41a36-0955-4bd1-83ad-4fe910c61c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.062890] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: UNINITIALIZED for 2s [ 671.342517] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f823533-7169-4a40-893f-35d2eea3d60c [ 671.342828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.342992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.343100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.343365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.343468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.343571] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f823533-7169-4a40-893f-35d2eea3d60c already deleted. [ 671.343682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f823533-7169-4a40-893f-35d2eea3d60c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.390720] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b755d42e-d250-4f75-9179-3ef054a079c6: rpc.has_security_group_logging(os_id): False [ 671.411053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.411227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.411321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.411546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.411645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.411848] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.411966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.412016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.412174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.412254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.415337] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.415445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.415445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.415620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.415705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.416017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.416017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.416179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.416281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.416320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.416406] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be created. [ 671.475031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.475031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.475031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.475031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.475286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.490127] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 671.829225] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: SUCCESS [ 671.829225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.829349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.829500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.829690] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.829802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.829865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.830038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.830095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.830177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.830262] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.901920] env[69358]: INFO networking_nsxv3.common.synchronization [req-809b072b-1a8b-465f-ba18-f58313240dfb req-d9ad019f-27f7-481a-940c-3d5de3751b5b tempest-ServersAdminTestJSON-846589263 tempest-ServersAdminTestJSON-846589263-project-member] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 671.902522] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 671.903318] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.903318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.903318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.903527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.903648] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.903792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.903891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.904114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.904240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.904377] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.969458] env[69358]: INFO networking_nsxv3.common.synchronization [req-e32dedce-f4bb-48e0-a77d-5c3ee268c6c1 req-f29432a4-30bc-43ac-8d15-79b342b6da4e tempest-SecurityGroupRulesTestJSON-370587668 tempest-SecurityGroupRulesTestJSON-370587668-project-member] Enqueued Resource ID: fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b with Priority: HIGHEST for action security_group_rules [ 671.969458] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b with Priority: HIGHEST for action security_group_rules [ 671.969637] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.969734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.969788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.971890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.971890] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.101425] env[69358]: INFO networking_nsxv3.common.synchronization [None req-29a070d2-4b51-465a-8158-ce0abb20a243 None None] Enqueued Resource ID: 9d115ecd-be49-4f2b-a582-965a400f5cdd with Priority: HIGHEST for action port [ 672.102975] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d115ecd-be49-4f2b-a582-965a400f5cdd with Priority: HIGHEST for action port [ 672.103331] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d115ecd-be49-4f2b-a582-965a400f5cdd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.103456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d115ecd-be49-4f2b-a582-965a400f5cdd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.103532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d115ecd-be49-4f2b-a582-965a400f5cdd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.103787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d115ecd-be49-4f2b-a582-965a400f5cdd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.103881] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d115ecd-be49-4f2b-a582-965a400f5cdd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.173707] env[69358]: INFO networking_nsxv3.common.synchronization [None req-48f8d936-6873-470c-a106-412941fbe23a None None] Enqueued Resource ID: e4eff08b-cb21-4065-a971-2298f0c0e34e with Priority: HIGHEST for action port [ 672.173946] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4eff08b-cb21-4065-a971-2298f0c0e34e with Priority: HIGHEST for action port [ 672.174511] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4eff08b-cb21-4065-a971-2298f0c0e34e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.174629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4eff08b-cb21-4065-a971-2298f0c0e34e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.174693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4eff08b-cb21-4065-a971-2298f0c0e34e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.174939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4eff08b-cb21-4065-a971-2298f0c0e34e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.175932] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4eff08b-cb21-4065-a971-2298f0c0e34e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.338220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.338220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.338220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.338220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.338220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.338819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.338819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.338819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.338819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.338819] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.406123] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.482217] env[69358]: INFO networking_nsxv3.common.synchronization [None req-a3245300-095d-41e2-ba95-d0b00065e4f6 tempest-ServersTestManualDisk-96811625 tempest-ServersTestManualDisk-96811625-project-member] Enqueued Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_rules [ 672.482747] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_rules [ 672.483139] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9495602c-f01c-4935-941b-dacd2d1ea667 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.483295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.483381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.483658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.483747] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.488858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.489013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.489084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.489343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.489439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.489532] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b already deleted. [ 672.489618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fba6f9c2-3e3c-44c5-85be-a9724e1ffd2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.609022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d115ecd-be49-4f2b-a582-965a400f5cdd [ 672.609269] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.609422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.609422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.609624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.609714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.609804] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d115ecd-be49-4f2b-a582-965a400f5cdd already deleted. [ 672.609883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d115ecd-be49-4f2b-a582-965a400f5cdd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.680668] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4eff08b-cb21-4065-a971-2298f0c0e34e [ 672.680668] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.680668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.680902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.683630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.683630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.683630] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4eff08b-cb21-4065-a971-2298f0c0e34e already deleted. [ 672.683630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4eff08b-cb21-4065-a971-2298f0c0e34e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.840779] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9: rpc.has_security_group_logging(os_id): False [ 672.848569] env[69358]: INFO networking_nsxv3.common.synchronization [None req-6439bd0f-d3c5-4a4c-bb08-e301f927c8f0 tempest-ServersTestManualDisk-96811625 tempest-ServersTestManualDisk-96811625-project-member] Enqueued Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_rules [ 672.850350] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_rules [ 672.850350] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9495602c-f01c-4935-941b-dacd2d1ea667 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.850350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.858789] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.858854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.858899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.859127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.859580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.859580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.859711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.859842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.859970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.860063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.860276] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.860372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.860431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.860577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.860653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.860831] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.860925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.860985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.861634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.861727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.861854] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 is going to be created. [ 672.908106] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.922396] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.922548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.923818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.923818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.923818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.933880] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: IN_PROGRESS for 2s [ 673.007021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.007021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.007021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.007021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.007021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.007021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9495602c-f01c-4935-941b-dacd2d1ea667 already deleted. [ 673.007021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.007021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.007021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.007021] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.051907] env[69358]: INFO networking_nsxv3.common.synchronization [req-1c81f306-9774-4abf-b014-d03dfc16b680 req-b688be6f-3393-4f41-a3e1-547b3500b8ca service nova] Enqueued Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_rules [ 673.051907] env[69358]: INFO networking_nsxv3.common.synchronization [req-1c81f306-9774-4abf-b014-d03dfc16b680 req-b688be6f-3393-4f41-a3e1-547b3500b8ca service nova] Enqueued Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_members [ 673.051907] env[69358]: INFO networking_nsxv3.common.synchronization [req-1c81f306-9774-4abf-b014-d03dfc16b680 req-b688be6f-3393-4f41-a3e1-547b3500b8ca service nova] Enqueued Resource ID: 8d4adce7-6b21-4372-aa4d-025ef83f4cd6 with Priority: HIGHEST for action port [ 673.051907] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_rules [ 673.051907] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_members [ 673.051907] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4adce7-6b21-4372-aa4d-025ef83f4cd6 with Priority: HIGHEST for action port [ 673.052352] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-908f61ef-0a88-4419-a8be-58a9e18a05ea taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.052471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.052537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.052767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.052850] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.054519] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-908f61ef-0a88-4419-a8be-58a9e18a05ea taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.054675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.054781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.055115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.055299] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.055430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.055519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.055690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.055805] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.055922] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.056727] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.056832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.056915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.057119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.057273] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d4adce7-6b21-4372-aa4d-025ef83f4cd6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.071762] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: SUCCESS [ 673.071960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.072371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.072640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.072822] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.072938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.073008] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.073169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.073337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.073427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.073514] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.162407] env[69358]: INFO networking_nsxv3.common.synchronization [req-9cd551f2-edf4-4e98-9c52-fc5fa857928b req-f15fa1be-4a82-4a9f-85cd-e07fd2e52733 service nova] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_rules [ 673.162632] env[69358]: INFO networking_nsxv3.common.synchronization [req-9cd551f2-edf4-4e98-9c52-fc5fa857928b req-f15fa1be-4a82-4a9f-85cd-e07fd2e52733 service nova] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 673.162817] env[69358]: INFO networking_nsxv3.common.synchronization [req-9cd551f2-edf4-4e98-9c52-fc5fa857928b req-f15fa1be-4a82-4a9f-85cd-e07fd2e52733 service nova] Enqueued Resource ID: 76e41a36-0955-4bd1-83ad-4fe910c61c6b with Priority: HIGHEST for action port [ 673.163391] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_rules [ 673.164253] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 673.164253] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76e41a36-0955-4bd1-83ad-4fe910c61c6b with Priority: HIGHEST for action port [ 673.167633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.167633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.167633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.167633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.167633] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.167633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.167633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.167633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-76e41a36-0955-4bd1-83ad-4fe910c61c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.167633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76e41a36-0955-4bd1-83ad-4fe910c61c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.168301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76e41a36-0955-4bd1-83ad-4fe910c61c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.168301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76e41a36-0955-4bd1-83ad-4fe910c61c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.168301] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76e41a36-0955-4bd1-83ad-4fe910c61c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.288307] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.288638] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.288638] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.288897] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.289205] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.289376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.289743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.290143] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.290231] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.291060] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.291060] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.291148] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.291414] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.291414] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.291756] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.291912] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.309338] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.309781] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 673.309781] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.309932] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.310524] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.310524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.310710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.311041] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.311485] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.411411] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.411581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.411655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.411885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.411982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.412094] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be created. [ 673.436632] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.436632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.436632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.436632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.436632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.446149] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: UNINITIALIZED for 2s [ 673.501661] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 673.501661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.530073] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.530073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.530073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.530073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.530073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.530073] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9495602c-f01c-4935-941b-dacd2d1ea667 already deleted. [ 673.530073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.559017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.560568] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-908f61ef-0a88-4419-a8be-58a9e18a05ea taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.560568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.560568] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d4adce7-6b21-4372-aa4d-025ef83f4cd6 with status ACTIVE [ 673.560876] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.560876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.560876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.562093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.562093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.562093] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.562093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.562093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.562093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.562093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.562896] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.563074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.563175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.563338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.563425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.563508] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d4adce7-6b21-4372-aa4d-025ef83f4cd6 is going to be updated. [ 673.578030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.578030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.578460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.578460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.582647] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.582647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.582647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.582647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.583081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.583081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.583150] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.583456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.583456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.583456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.583601] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.583831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.583831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.583913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.584070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.584070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.584200] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.586064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.586064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.586204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.587470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.587470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.587470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d4adce7-6b21-4372-aa4d-025ef83f4cd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.673026] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.673026] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76e41a36-0955-4bd1-83ad-4fe910c61c6b with status ACTIVE [ 673.673026] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.673026] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.673026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.673026] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.673677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.673677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.673677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.673677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.673677] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76e41a36-0955-4bd1-83ad-4fe910c61c6b is going to be updated. [ 673.713773] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.713773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.713773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.713773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.713773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.713773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76e41a36-0955-4bd1-83ad-4fe910c61c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.814325] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.814615] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.814877] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.815049] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.815182] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.815381] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0 not found, creating... [ 673.815630] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.815769] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.817499] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.817887] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.818156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.818617] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.818922] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.819086] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.820431] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.820431] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.820431] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0 is going to be created. [ 673.846481] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.847397] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.847397] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.847397] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.847558] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.847964] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.042036] env[69358]: INFO networking_nsxv3.common.synchronization [None req-db585138-5d35-4085-ba1e-82b0d0565ecf None None] Enqueued Resource ID: a01e2bb8-c03c-4daf-bc91-0f82b6c99470 with Priority: HIGHEST for action port [ 674.042036] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a01e2bb8-c03c-4daf-bc91-0f82b6c99470 with Priority: HIGHEST for action port [ 674.042036] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a01e2bb8-c03c-4daf-bc91-0f82b6c99470 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.042036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a01e2bb8-c03c-4daf-bc91-0f82b6c99470" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.042036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a01e2bb8-c03c-4daf-bc91-0f82b6c99470" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.042036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a01e2bb8-c03c-4daf-bc91-0f82b6c99470" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.042036] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a01e2bb8-c03c-4daf-bc91-0f82b6c99470',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.065847] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.087910] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38b21152-b672-43d0-bb12-4ff761d0e3a8: rpc.has_security_group_logging(os_id): False [ 674.129933] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.130100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.130364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.130485] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.130541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.130707] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.130855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.130947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.131176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.131309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.131570] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.131697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.131766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.131916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.131993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.132214] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.132339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.132395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.132584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.132671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.132761] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be created. [ 674.211295] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.211437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.211558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.211715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.211887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.224235] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: IN_PROGRESS for 2s [ 674.550136] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a01e2bb8-c03c-4daf-bc91-0f82b6c99470 [ 674.550136] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.550136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.550136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.550136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.550136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.550136] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a01e2bb8-c03c-4daf-bc91-0f82b6c99470 already deleted. [ 674.550136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a01e2bb8-c03c-4daf-bc91-0f82b6c99470" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.568823] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.568823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.569425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.569784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.569857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.570308] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea is going to be created. [ 674.599255] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.599467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.599467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.599641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.599976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.609932] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea in Status: UNINITIALIZED for 2s [ 674.948500] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: SUCCESS [ 674.948733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.068782] env[69358]: INFO networking_nsxv3.common.synchronization [None req-5fad2974-f15a-4f3d-8cc4-c159b4255c06 None None] Enqueued Resource ID: c168b222-99a6-4c85-9467-afbe91939c76 with Priority: HIGHEST for action port [ 675.069290] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c168b222-99a6-4c85-9467-afbe91939c76 with Priority: HIGHEST for action port [ 675.071512] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-c168b222-99a6-4c85-9467-afbe91939c76 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.071512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c168b222-99a6-4c85-9467-afbe91939c76" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.071512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c168b222-99a6-4c85-9467-afbe91939c76" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.074034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c168b222-99a6-4c85-9467-afbe91939c76" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.074034] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c168b222-99a6-4c85-9467-afbe91939c76',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.167284] env[69358]: INFO networking_nsxv3.common.synchronization [req-809b072b-1a8b-465f-ba18-f58313240dfb req-7ceb8a16-7244-4152-9b45-4077a218e6ff service nova] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_rules [ 675.167284] env[69358]: INFO networking_nsxv3.common.synchronization [req-809b072b-1a8b-465f-ba18-f58313240dfb req-7ceb8a16-7244-4152-9b45-4077a218e6ff service nova] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 675.167284] env[69358]: INFO networking_nsxv3.common.synchronization [req-809b072b-1a8b-465f-ba18-f58313240dfb req-7ceb8a16-7244-4152-9b45-4077a218e6ff service nova] Enqueued Resource ID: e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0 with Priority: HIGHEST for action port [ 675.167284] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_rules [ 675.167284] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 675.167284] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0 with Priority: HIGHEST for action port [ 675.168122] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.168413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.168785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.171403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.171403] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.171403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.171403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.171403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.171403] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.455507] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 675.455809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.456301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.456702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.456949] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.457115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.457900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.457900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.457900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.457900] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.577418] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c168b222-99a6-4c85-9467-afbe91939c76 [ 675.577655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.577792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.577904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.578102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.578188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.578287] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c168b222-99a6-4c85-9467-afbe91939c76 already deleted. [ 675.579030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c168b222-99a6-4c85-9467-afbe91939c76" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.633821] env[69358]: INFO networking_nsxv3.common.synchronization [None req-8df38c30-5132-49c2-a2fe-5c24d6adc134 None None] Enqueued Resource ID: b8968151-1229-4e3e-ab03-bed0b054df03 with Priority: HIGHEST for action port [ 675.634386] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8968151-1229-4e3e-ab03-bed0b054df03 with Priority: HIGHEST for action port [ 675.634695] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8968151-1229-4e3e-ab03-bed0b054df03 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.634809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8968151-1229-4e3e-ab03-bed0b054df03" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.634873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8968151-1229-4e3e-ab03-bed0b054df03" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.635269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8968151-1229-4e3e-ab03-bed0b054df03" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.635348] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8968151-1229-4e3e-ab03-bed0b054df03',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.672102] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0 with status ACTIVE [ 675.672916] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.673233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.673394] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.673971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.673971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.674169] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.675903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.675903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.675903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.675903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.675903] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.675903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.675903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.675903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.675903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.675903] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0 is going to be updated. [ 675.699630] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.699845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.699959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.700235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.701444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.701723] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4ff829b-418e-42ce-a3fa-9f5c4edd5fb0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.961419] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.098957] env[69358]: INFO networking_nsxv3.common.synchronization [None req-27961dd4-abef-478c-a306-5e1f9649c937 None None] Enqueued Resource ID: 3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b with Priority: HIGHEST for action port [ 676.099274] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b with Priority: HIGHEST for action port [ 676.099854] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.099975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.101016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.101016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.101016] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.137700] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8968151-1229-4e3e-ab03-bed0b054df03 [ 676.137944] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.138102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.138175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.138410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.138499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.138605] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8968151-1229-4e3e-ab03-bed0b054df03 already deleted. [ 676.138684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8968151-1229-4e3e-ab03-bed0b054df03" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.235439] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: SUCCESS [ 676.235652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.447423] env[69358]: INFO networking_nsxv3.common.synchronization [req-0aa89312-63e6-466c-b312-bd2322fadc83 req-6eb3b743-f086-4633-88a9-ef5c9130f2d5 tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 676.447423] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 676.447423] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.447423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.447423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.448376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.448555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.448877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.448950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.449350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.449457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.449554] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.464732] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.604595] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b [ 676.604595] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.604595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.604595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.604595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.604595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.604595] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b already deleted. [ 676.604595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dd0cf7b-69e8-4122-90ef-6a0c22e55d6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.621060] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea in Status: SUCCESS [ 676.621294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.621456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.621730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.621943] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.622096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.622170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.622332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.622406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.622488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.622737] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.896148] env[69358]: INFO networking_nsxv3.common.synchronization [None req-f72ecf6a-72be-4c3e-9fb2-996c55737417 None None] Enqueued Resource ID: 4c0cb9c9-e4c8-4a59-86c0-129a52822660 with Priority: HIGHEST for action port [ 676.896410] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0cb9c9-e4c8-4a59-86c0-129a52822660 with Priority: HIGHEST for action port [ 676.896977] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c0cb9c9-e4c8-4a59-86c0-129a52822660 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.897113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c0cb9c9-e4c8-4a59-86c0-129a52822660" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.897180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c0cb9c9-e4c8-4a59-86c0-129a52822660" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.897438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c0cb9c9-e4c8-4a59-86c0-129a52822660" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.897522] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c0cb9c9-e4c8-4a59-86c0-129a52822660',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.952585] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.952737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.953091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.953091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.956834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.957106] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.957222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.957286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.957472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.957560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.957648] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 already deleted. [ 676.957728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.968432] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.968627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.968665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.968833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.968914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.969011] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 676.999019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.002614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.002614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.002614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.002614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.009253] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 677.127225] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.362116] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.362604] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.362681] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.362959] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.363239] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.365016] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.365016] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.365016] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.365016] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.365016] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.365016] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.365016] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.365016] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.365016] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.365016] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.365016] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.385159] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.385371] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 677.388163] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.388163] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.388163] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-b8c23b0a-ef08-4666-a632-22641fa7e6ba taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.388163] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-b8c23b0a-ef08-4666-a632-22641fa7e6ba" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.388163] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-b8c23b0a-ef08-4666-a632-22641fa7e6ba" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.388163] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-b8c23b0a-ef08-4666-a632-22641fa7e6ba" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.388163] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c23b0a-ef08-4666-a632-22641fa7e6ba',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.400540] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c0cb9c9-e4c8-4a59-86c0-129a52822660 [ 677.400540] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.402901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.402901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.402901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.402901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.402901] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c0cb9c9-e4c8-4a59-86c0-129a52822660 already deleted. [ 677.402901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c0cb9c9-e4c8-4a59-86c0-129a52822660" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.629962] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 908f61ef-0a88-4419-a8be-58a9e18a05ea: rpc.has_security_group_logging(os_id): False [ 677.648181] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.648181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.648409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.648638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.648748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.649129] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.649390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.649390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.653174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.653301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.653387] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea is going to be created. [ 677.684830] env[69358]: INFO networking_nsxv3.common.synchronization [req-43c6bad4-eb5a-4993-9c77-0ceb85ca78a6 req-c316e937-f578-4bde-9c5e-3421167af274 tempest-SecurityGroupRulesTestJSON-370587668 tempest-SecurityGroupRulesTestJSON-370587668-project-member] Enqueued Resource ID: c07f56e1-dc3b-4217-ad84-6b10ece22bae with Priority: HIGHEST for action security_group_rules [ 677.685493] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07f56e1-dc3b-4217-ad84-6b10ece22bae with Priority: HIGHEST for action security_group_rules [ 677.685493] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c07f56e1-dc3b-4217-ad84-6b10ece22bae taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.685648] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c07f56e1-dc3b-4217-ad84-6b10ece22bae" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.685685] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c07f56e1-dc3b-4217-ad84-6b10ece22bae" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.685925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c07f56e1-dc3b-4217-ad84-6b10ece22bae" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.686120] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c07f56e1-dc3b-4217-ad84-6b10ece22bae',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.708418] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.708543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.708543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.708781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.708963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.719668] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea in Status: IN_PROGRESS for 2s [ 677.894024] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.894024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.894024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.894024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.894024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.894024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port b8c23b0a-ef08-4666-a632-22641fa7e6ba not found, creating... [ 677.894024] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.894024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.894024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.894024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.894024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.894562] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.894562] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.894562] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.894562] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.894710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.895101] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: b8c23b0a-ef08-4666-a632-22641fa7e6ba is going to be created. [ 677.915444] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.916569] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.916724] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.917009] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.917278] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.917508] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-b8c23b0a-ef08-4666-a632-22641fa7e6ba" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.208237] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.208237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.208237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.208676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.208676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.208676] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c07f56e1-dc3b-4217-ad84-6b10ece22bae already deleted. [ 678.208676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c07f56e1-dc3b-4217-ad84-6b10ece22bae" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.330614] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c574b67-44c5-4717-94b1-d554c67f6b1e req-5a037d47-139d-4320-b2ae-5b84a791328d tempest-ServerMetadataTestJSON-1342094692 tempest-ServerMetadataTestJSON-1342094692-project-member] Enqueued Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGHEST for action security_group_members [ 678.332103] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGHEST for action security_group_members [ 678.332103] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-399e5b2f-147f-4c05-b525-1c92b4bd694d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.332103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.332103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.332103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.332327] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.332419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.332419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.332575] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.332657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.332745] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.837926] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.838112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.838175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.838397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.838490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.838679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.838780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.838851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.839613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.839613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.839613] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d already deleted. [ 678.839613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.884365] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.884365] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-941" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.884365] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-941" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.884624] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-941" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.884885] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.885124] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.885255] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.885499] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.885650] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.885888] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.890020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.890020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.890020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.890020] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.890020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.890020] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.908875] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.909067] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.909211] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.909510] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-941" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.909897] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-2bbbb62d-0660-42da-9b07-6e7e73248b46 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.910100] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-2bbbb62d-0660-42da-9b07-6e7e73248b46" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.910228] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-2bbbb62d-0660-42da-9b07-6e7e73248b46" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.910553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-2bbbb62d-0660-42da-9b07-6e7e73248b46" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.910698] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bbbb62d-0660-42da-9b07-6e7e73248b46',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.019263] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 679.019398] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.019562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.019793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.020034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.020150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.020221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.020480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.020562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.020654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.020870] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.023359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.023858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.024063] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.024195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.024264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.024419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.024509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.024605] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.112662] env[69358]: INFO networking_nsxv3.common.synchronization [req-0aa89312-63e6-466c-b312-bd2322fadc83 req-d340bc43-707b-4fe0-b9bd-cbb6f9134e8a service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 679.112931] env[69358]: INFO networking_nsxv3.common.synchronization [req-0aa89312-63e6-466c-b312-bd2322fadc83 req-d340bc43-707b-4fe0-b9bd-cbb6f9134e8a service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 679.113091] env[69358]: INFO networking_nsxv3.common.synchronization [req-0aa89312-63e6-466c-b312-bd2322fadc83 req-d340bc43-707b-4fe0-b9bd-cbb6f9134e8a service nova] Enqueued Resource ID: b8c23b0a-ef08-4666-a632-22641fa7e6ba with Priority: HIGHEST for action port [ 679.113809] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 679.113967] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 679.114556] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c23b0a-ef08-4666-a632-22641fa7e6ba with Priority: HIGHEST for action port [ 679.114556] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.114673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.114673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.114899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.114988] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.116017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.116131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.116167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.116330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.116499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.116604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.116666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.116815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.116903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.116997] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.118908] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8c23b0a-ef08-4666-a632-22641fa7e6ba taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.119176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8c23b0a-ef08-4666-a632-22641fa7e6ba" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.119449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8c23b0a-ef08-4666-a632-22641fa7e6ba" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.119880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8c23b0a-ef08-4666-a632-22641fa7e6ba" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.119995] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c23b0a-ef08-4666-a632-22641fa7e6ba',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.414904] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.415278] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.415542] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.416128] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.416412] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.417155] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 2bbbb62d-0660-42da-9b07-6e7e73248b46 not found, creating... [ 679.417198] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.418030] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.418030] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.418030] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.418332] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.418702] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.418931] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.419134] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.419456] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.419669] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.419877] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 2bbbb62d-0660-42da-9b07-6e7e73248b46 is going to be created. [ 679.441438] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.442041] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.442041] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.442160] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.442303] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.442498] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-2bbbb62d-0660-42da-9b07-6e7e73248b46" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.528579] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.528579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.528579] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.626025] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.626025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.626025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.627341] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8c23b0a-ef08-4666-a632-22641fa7e6ba with status ACTIVE [ 679.627801] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.628112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.631295] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.631295] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.631295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.631295] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8c23b0a-ef08-4666-a632-22641fa7e6ba is going to be updated. [ 679.651665] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.651899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.651978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.652229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.652414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.652844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8c23b0a-ef08-4666-a632-22641fa7e6ba" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.738191] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea in Status: SUCCESS [ 679.738191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.030548] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.124307] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.484675] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c574b67-44c5-4717-94b1-d554c67f6b1e req-f1b281f0-ebb0-4f77-a4a2-347e828ac69d service nova] Enqueued Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGHEST for action security_group_rules [ 680.484675] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c574b67-44c5-4717-94b1-d554c67f6b1e req-f1b281f0-ebb0-4f77-a4a2-347e828ac69d service nova] Enqueued Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGHEST for action security_group_members [ 680.484675] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c574b67-44c5-4717-94b1-d554c67f6b1e req-f1b281f0-ebb0-4f77-a4a2-347e828ac69d service nova] Enqueued Resource ID: 2bbbb62d-0660-42da-9b07-6e7e73248b46 with Priority: HIGHEST for action port [ 680.485440] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGHEST for action security_group_rules [ 680.489961] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGHEST for action security_group_members [ 680.489961] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bbbb62d-0660-42da-9b07-6e7e73248b46 with Priority: HIGHEST for action port [ 680.489961] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-399e5b2f-147f-4c05-b525-1c92b4bd694d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.489961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.489961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.490268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.490268] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.492076] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-399e5b2f-147f-4c05-b525-1c92b4bd694d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.492076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.492568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.492568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.492788] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.493008] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.493397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.493493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.493655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.493833] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.499836] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bbbb62d-0660-42da-9b07-6e7e73248b46 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.499836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bbbb62d-0660-42da-9b07-6e7e73248b46" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.499836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bbbb62d-0660-42da-9b07-6e7e73248b46" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.500374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bbbb62d-0660-42da-9b07-6e7e73248b46" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.500477] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bbbb62d-0660-42da-9b07-6e7e73248b46',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.502881] env[69358]: INFO networking_nsxv3.common.synchronization [None req-5c1b6cdc-c465-47bd-90c3-73a972fcfcaa None None] Enqueued Resource ID: 484f2882-2865-404e-83eb-f70d95c2f090 with Priority: HIGHEST for action port [ 680.506112] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 484f2882-2865-404e-83eb-f70d95c2f090 with Priority: HIGHEST for action port [ 680.507168] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-484f2882-2865-404e-83eb-f70d95c2f090 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.507168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-484f2882-2865-404e-83eb-f70d95c2f090" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.507168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-484f2882-2865-404e-83eb-f70d95c2f090" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.507168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-484f2882-2865-404e-83eb-f70d95c2f090" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.507168] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('484f2882-2865-404e-83eb-f70d95c2f090',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.534468] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.534468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.534468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.534468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.534722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.534722] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 680.563253] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.563442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.563486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.563855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.563855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.572061] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 680.627858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.627858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.627858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.628224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.628224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.628224] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be created. [ 680.650304] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.650563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.650563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.650904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.650904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.659374] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: UNINITIALIZED for 2s [ 680.772221] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c71faedd-54e6-4ce8-898f-d7b7cdfaa0c8 None None] Enqueued Resource ID: 7fd41d1a-e410-4c46-a727-cc9c82e59f77 with Priority: HIGHEST for action port [ 680.772221] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd41d1a-e410-4c46-a727-cc9c82e59f77 with Priority: HIGHEST for action port [ 680.772504] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fd41d1a-e410-4c46-a727-cc9c82e59f77 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.772785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fd41d1a-e410-4c46-a727-cc9c82e59f77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.772952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fd41d1a-e410-4c46-a727-cc9c82e59f77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.773285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fd41d1a-e410-4c46-a727-cc9c82e59f77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.773459] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fd41d1a-e410-4c46-a727-cc9c82e59f77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.006495] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-399e5b2f-147f-4c05-b525-1c92b4bd694d taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.008149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.008149] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.008149] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bbbb62d-0660-42da-9b07-6e7e73248b46 with status ACTIVE [ 681.008450] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.008450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.008540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.008728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.008821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.008994] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.009261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.009261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.009391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.009425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.009598] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.009695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.009757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.009900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.009974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.011982] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bbbb62d-0660-42da-9b07-6e7e73248b46 is going to be updated. [ 681.013379] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 484f2882-2865-404e-83eb-f70d95c2f090 [ 681.013740] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.013740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.013740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.013925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.013925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.014030] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:484f2882-2865-404e-83eb-f70d95c2f090 already deleted. [ 681.014186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-484f2882-2865-404e-83eb-f70d95c2f090" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.042013] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.042182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.042252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.042489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.042616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.042773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bbbb62d-0660-42da-9b07-6e7e73248b46" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.277786] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fd41d1a-e410-4c46-a727-cc9c82e59f77 [ 681.277786] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.277919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.277919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.278144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.278281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.278323] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fd41d1a-e410-4c46-a727-cc9c82e59f77 already deleted. [ 681.278405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fd41d1a-e410-4c46-a727-cc9c82e59f77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.438254] env[69358]: INFO networking_nsxv3.common.synchronization [req-14bb35f7-663c-4c59-b322-0f1af0601a39 req-ea84d2ba-8e4a-426f-b9ca-d2cb49248180 tempest-ServersWithSpecificFlavorTestJSON-1142878247 tempest-ServersWithSpecificFlavorTestJSON-1142878247-project-member] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 681.438518] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 681.438749] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.439648] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.439826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.441484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.442342] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.442342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.442342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.442342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.442342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.442342] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.515105] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.944258] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.944441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.944516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.944764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.944903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.945149] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.945304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.945403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.945617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.945726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.945836] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b already deleted. [ 681.945943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.020848] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.021029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.021101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.021395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.021467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.021509] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d is going to be created. [ 682.043646] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.043646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.043646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.043876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.044023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.057086] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d in Status: UNINITIALIZED for 2s [ 682.557694] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-338 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.557993] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-338" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.558055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-338" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.561019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-338" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.561019] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.561019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.561019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.562652] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.562823] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.563046] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.563248] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.563322] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.563433] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.563546] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.563651] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.563779] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.580910] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 682.581176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.581271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.581476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.582142] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.582142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.582142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.582142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.582142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.582142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.582503] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.582503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.582503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.582614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.582648] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.582901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.582901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.583040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.583040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.583103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.583181] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.584731] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.585029] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.585029] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.585197] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-338" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.587186] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a0bc0472-3933-41df-8a1e-68d52295827e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.587186] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a0bc0472-3933-41df-8a1e-68d52295827e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.587186] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a0bc0472-3933-41df-8a1e-68d52295827e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.587186] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a0bc0472-3933-41df-8a1e-68d52295827e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.587186] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0bc0472-3933-41df-8a1e-68d52295827e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.670298] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 682.670588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.673380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.673380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.673380] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.673380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.673380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.673380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.673380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.673380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.673380] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.686021] env[69358]: INFO networking_nsxv3.common.synchronization [None req-0ddfba0c-232b-4112-8f17-1d2d388f7393 None None] Enqueued Resource ID: 55d863aa-4b30-4439-96bc-8dca90dd70f6 with Priority: HIGHEST for action port [ 682.686021] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d863aa-4b30-4439-96bc-8dca90dd70f6 with Priority: HIGHEST for action port [ 682.686021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-55d863aa-4b30-4439-96bc-8dca90dd70f6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.686021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55d863aa-4b30-4439-96bc-8dca90dd70f6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.686021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55d863aa-4b30-4439-96bc-8dca90dd70f6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.686021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55d863aa-4b30-4439-96bc-8dca90dd70f6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.686021] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d863aa-4b30-4439-96bc-8dca90dd70f6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.090251] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.090251] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.090251] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.090533] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.090533] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.090691] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a0bc0472-3933-41df-8a1e-68d52295827e not found, creating... [ 683.090973] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.091205] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.091282] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.091900] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.091900] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.091900] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.092565] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.092767] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.093117] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.095157] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.095157] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a0bc0472-3933-41df-8a1e-68d52295827e is going to be created. [ 683.095157] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6825e81-3f64-4e7b-908b-47b35fcde1e2: rpc.has_security_group_logging(os_id): False [ 683.102612] env[69358]: INFO networking_nsxv3.common.synchronization [req-e878229f-a491-4049-bbcf-b96c1ca11db3 req-e5af52aa-ebee-4168-a617-fee09c5c61ea tempest-SecurityGroupRulesTestJSON-370587668 tempest-SecurityGroupRulesTestJSON-370587668-project-member] Enqueued Resource ID: e3eb41aa-3e98-4e70-9745-f02f8ee1346b with Priority: HIGHEST for action security_group_rules [ 683.102612] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3eb41aa-3e98-4e70-9745-f02f8ee1346b with Priority: HIGHEST for action security_group_rules [ 683.102612] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3eb41aa-3e98-4e70-9745-f02f8ee1346b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.102612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3eb41aa-3e98-4e70-9745-f02f8ee1346b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.102612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3eb41aa-3e98-4e70-9745-f02f8ee1346b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.102612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3eb41aa-3e98-4e70-9745-f02f8ee1346b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.104887] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3eb41aa-3e98-4e70-9745-f02f8ee1346b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.114126] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.114398] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.114493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.114711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.114804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.115021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.115123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.115185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.115763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.116063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.116102] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.119151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.119151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.119151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.119151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.119151] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.119151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.119151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.119151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.119151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.119151] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be created. [ 683.122364] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.123390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.123390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.123390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.123390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.123583] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a0bc0472-3933-41df-8a1e-68d52295827e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.181156] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.181156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.181156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.181156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.181156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.181156] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.181156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.181156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.181156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.182581] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.185454] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.185454] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.185454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.185454] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.192211] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55d863aa-4b30-4439-96bc-8dca90dd70f6 [ 683.192211] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.192211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.192211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.192211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.192211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.192211] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55d863aa-4b30-4439-96bc-8dca90dd70f6 already deleted. [ 683.192211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55d863aa-4b30-4439-96bc-8dca90dd70f6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.202357] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 683.624100] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.624100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.624100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.624497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.624497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.628025] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3eb41aa-3e98-4e70-9745-f02f8ee1346b already deleted. [ 683.628025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3eb41aa-3e98-4e70-9745-f02f8ee1346b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.687847] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e45a41dd-b21d-4639-af89-ce7883a3d987: rpc.has_security_group_logging(os_id): False [ 683.704386] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.704386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.704386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.704571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.704874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.704874] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.704960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.704997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.706061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.706061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.706061] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.706061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.706061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.706061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.706061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.706061] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.706945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.707068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.707309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.707309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.707309] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be created. [ 683.758836] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.759253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.759253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.759455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.760520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.771706] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 684.071504] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d in Status: SUCCESS [ 684.071504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.071504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.072509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.072509] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.072509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.072509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.072509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.072509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.072509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.072509] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.161201] env[69358]: INFO networking_nsxv3.common.synchronization [req-14bb35f7-663c-4c59-b322-0f1af0601a39 req-08f042f0-6822-4399-8cbb-a6f0237b44bf service nova] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_rules [ 684.161201] env[69358]: INFO networking_nsxv3.common.synchronization [req-14bb35f7-663c-4c59-b322-0f1af0601a39 req-08f042f0-6822-4399-8cbb-a6f0237b44bf service nova] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 684.161201] env[69358]: INFO networking_nsxv3.common.synchronization [req-14bb35f7-663c-4c59-b322-0f1af0601a39 req-08f042f0-6822-4399-8cbb-a6f0237b44bf service nova] Enqueued Resource ID: a0bc0472-3933-41df-8a1e-68d52295827e with Priority: HIGHEST for action port [ 684.161201] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_rules [ 684.161201] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 684.161201] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc0472-3933-41df-8a1e-68d52295827e with Priority: HIGHEST for action port [ 684.161201] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.161201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.161201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.161201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.163611] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.164670] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.164670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.164670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.164670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.165078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.165078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.165078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.165515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.165515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.166400] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.167495] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0bc0472-3933-41df-8a1e-68d52295827e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.167659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0bc0472-3933-41df-8a1e-68d52295827e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.167778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0bc0472-3933-41df-8a1e-68d52295827e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.168098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0bc0472-3933-41df-8a1e-68d52295827e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.168136] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0bc0472-3933-41df-8a1e-68d52295827e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.398387] env[69358]: INFO networking_nsxv3.common.synchronization [req-5f982fbd-69ea-4b82-b3cb-ad61278654d2 req-f6fa500c-a8cd-4095-b2b2-ea833ab8d91e tempest-DeleteServersAdminTestJSON-1119230141 tempest-DeleteServersAdminTestJSON-1119230141-project-admin] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 684.398387] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 684.398387] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.398387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.398387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.400067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.400588] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.400588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.400588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.401619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.401619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.401713] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.577488] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-399e5b2f-147f-4c05-b525-1c92b4bd694d taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.577680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.577767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.578013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.578187] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.578327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.578422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.578603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.578697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.578794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.578945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-399e5b2f-147f-4c05-b525-1c92b4bd694d taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.579580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.579580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.579580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.579580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.579580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.579580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.579885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.579885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.579885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.579971] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.670353] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.671480] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.671615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.678076] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0bc0472-3933-41df-8a1e-68d52295827e with status ACTIVE [ 684.678264] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.678403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.678468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.678698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.678788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.679013] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.679069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.679118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.679637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.679637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.679637] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.679791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.679791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.679872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.679971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.680040] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0bc0472-3933-41df-8a1e-68d52295827e is going to be updated. [ 684.702142] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.702326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.702366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.702569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.702705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.702875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0bc0472-3933-41df-8a1e-68d52295827e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.907642] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.908136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.908210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.908441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.908546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.908779] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.908894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.909514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.909514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.909514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.909514] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 is going to be updated. [ 684.939119] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.939119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.939119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.939119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.939377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.951751] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: IN_PROGRESS for 2s [ 685.085200] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 399e5b2f-147f-4c05-b525-1c92b4bd694d: rpc.has_security_group_logging(os_id): False [ 685.109723] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.109947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.110015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.110283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.110430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.110752] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.110893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.111041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.111237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.111594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.111594] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.111714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.111714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.112363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.112363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.112857] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.112857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.112857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.113045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.113045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.113111] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d is going to be created. [ 685.168413] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.168413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.168413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.168413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.168413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.174688] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.183320] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d in Status: IN_PROGRESS for 2s [ 685.230283] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 685.230405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.230598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.231419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.231419] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.369371] env[69358]: INFO networking_nsxv3.common.synchronization [None req-8b0dd033-76f9-4dc6-8be1-93fa302654d9 None None] Enqueued Resource ID: 99f75c00-5010-457f-bac1-5ddc4d521305 with Priority: HIGHEST for action port [ 685.369942] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99f75c00-5010-457f-bac1-5ddc4d521305 with Priority: HIGHEST for action port [ 685.370625] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-99f75c00-5010-457f-bac1-5ddc4d521305 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.370776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99f75c00-5010-457f-bac1-5ddc4d521305" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.370898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99f75c00-5010-457f-bac1-5ddc4d521305" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.371262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99f75c00-5010-457f-bac1-5ddc4d521305" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.371366] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f75c00-5010-457f-bac1-5ddc4d521305',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.681456] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.681836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.681889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.682575] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.682911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.682911] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be created. [ 685.710242] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.710480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.710480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.710891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.710992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.722020] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: UNINITIALIZED for 2s [ 685.735592] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.735810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.735861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.736642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.736642] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.736642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.736642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.736642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.736642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.736916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.736916] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.781215] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 685.781606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.874727] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99f75c00-5010-457f-bac1-5ddc4d521305 [ 685.874727] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.874727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.874727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.874727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.874727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.874727] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99f75c00-5010-457f-bac1-5ddc4d521305 already deleted. [ 685.875351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99f75c00-5010-457f-bac1-5ddc4d521305" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.219630] env[69358]: INFO networking_nsxv3.common.synchronization [req-e7f91a6a-bdb5-4297-ba2e-7f7221989333 req-5c73dc1b-3204-469a-ae12-a8214c8fa2db tempest-InstanceActionsV221TestJSON-421179459 tempest-InstanceActionsV221TestJSON-421179459-project-member] Enqueued Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGHEST for action security_group_members [ 686.223261] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGHEST for action security_group_members [ 686.226640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.226640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.226640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.226640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.226640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.226640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.226640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.226640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.226640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.226640] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.248666] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.248666] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.248666] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.248666] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.248666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.249861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.249861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.249861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.249861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.249861] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.734806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.734806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.735135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.735135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.735201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.735790] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.735790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.735790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.735790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.735790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.736125] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 already deleted. [ 686.736125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.749188] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6825e81-3f64-4e7b-908b-47b35fcde1e2: rpc.has_security_group_logging(os_id): False [ 686.772635] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.772814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.772893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.773153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.773248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.773471] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.774029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.774029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.774029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.774029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.774224] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.775025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.775025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.775025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.775025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.775190] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.775253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.775315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.775506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.775601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.775679] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 686.859565] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.859565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.859565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.859565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.859565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.876141] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 686.963611] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: SUCCESS [ 686.963611] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 deletion is rescheduled due to dependency. [ 686.963611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.990381] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-857 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.990673] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-857" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.990804] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-857" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.991187] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-857" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.991506] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.991698] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.991841] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.992125] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.992307] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.992543] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.992707] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.992871] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.993014] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.993197] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.993330] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.993468] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.016050] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.016050] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.016050] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.016050] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-857" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.016050] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e92d54c2-2104-4901-9fde-ba68a1528dfb taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.016050] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e92d54c2-2104-4901-9fde-ba68a1528dfb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.016050] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e92d54c2-2104-4901-9fde-ba68a1528dfb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.016050] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e92d54c2-2104-4901-9fde-ba68a1528dfb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.016050] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e92d54c2-2104-4901-9fde-ba68a1528dfb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.192038] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d in Status: SUCCESS [ 687.192038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.519511] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.519511] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.520558] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.520558] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.520786] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.520864] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e92d54c2-2104-4901-9fde-ba68a1528dfb not found, creating... [ 687.521162] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.523087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.523087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.523087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.523087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.523087] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.523087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.523087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.523087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.523087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.523087] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e92d54c2-2104-4901-9fde-ba68a1528dfb is going to be created. [ 687.544385] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.544663] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.544809] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.545248] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.545510] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.545899] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e92d54c2-2104-4901-9fde-ba68a1528dfb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.731998] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: SUCCESS [ 687.732419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.732700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.732923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.733151] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.733281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.733375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.733541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.733641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.733722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.733797] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.743952] env[69358]: INFO networking_nsxv3.common.synchronization [req-b1c6d7bf-a88c-46e5-8f07-6bc51c7cf5b6 req-3205822f-6b75-47cb-9d0c-3fedf62eebed tempest-SecurityGroupRulesTestJSON-370587668 tempest-SecurityGroupRulesTestJSON-370587668-project-member] Enqueued Resource ID: 88a369be-c206-48d2-b581-31ef2ffd5d54 with Priority: HIGHEST for action security_group_rules [ 687.744247] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a369be-c206-48d2-b581-31ef2ffd5d54 with Priority: HIGHEST for action security_group_rules [ 687.744797] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a369be-c206-48d2-b581-31ef2ffd5d54 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.745278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a369be-c206-48d2-b581-31ef2ffd5d54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.745278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a369be-c206-48d2-b581-31ef2ffd5d54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.745278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a369be-c206-48d2-b581-31ef2ffd5d54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.745278] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a369be-c206-48d2-b581-31ef2ffd5d54',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.807148] env[69358]: INFO networking_nsxv3.common.synchronization [None req-e70428b9-ac97-440b-af6f-dd8cf0e4f7ed None None] Enqueued Resource ID: ec71926b-9601-4fb7-9fc4-a9748beca27d with Priority: HIGHEST for action port [ 687.808662] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec71926b-9601-4fb7-9fc4-a9748beca27d with Priority: HIGHEST for action port [ 687.808662] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec71926b-9601-4fb7-9fc4-a9748beca27d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.810313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec71926b-9601-4fb7-9fc4-a9748beca27d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.810313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec71926b-9601-4fb7-9fc4-a9748beca27d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.810313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec71926b-9601-4fb7-9fc4-a9748beca27d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.810313] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec71926b-9601-4fb7-9fc4-a9748beca27d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.236834] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.266129] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.266357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.266441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.266718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.266840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.266966] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a369be-c206-48d2-b581-31ef2ffd5d54 already deleted. [ 688.267155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a369be-c206-48d2-b581-31ef2ffd5d54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.319867] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec71926b-9601-4fb7-9fc4-a9748beca27d [ 688.319942] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.320012] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.320249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.320326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.320412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.320508] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec71926b-9601-4fb7-9fc4-a9748beca27d already deleted. [ 688.320628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec71926b-9601-4fb7-9fc4-a9748beca27d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.739443] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 689199c8-8cdd-4299-865b-276e93b23c6b: rpc.has_security_group_logging(os_id): False [ 688.758037] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.758037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.758037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.758037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.758037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.758531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.758531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.758531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.758531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.758531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.758688] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be created. [ 688.813209] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.813209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.813209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.813351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.813950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.827271] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: IN_PROGRESS for 2s [ 688.885849] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 688.886093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.107590] env[69358]: INFO networking_nsxv3.common.synchronization [req-e7f91a6a-bdb5-4297-ba2e-7f7221989333 req-76c0f462-2f66-493c-a61e-609709b2ebc7 service nova] Enqueued Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGHEST for action security_group_rules [ 689.107659] env[69358]: INFO networking_nsxv3.common.synchronization [req-e7f91a6a-bdb5-4297-ba2e-7f7221989333 req-76c0f462-2f66-493c-a61e-609709b2ebc7 service nova] Enqueued Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGHEST for action security_group_members [ 689.107744] env[69358]: INFO networking_nsxv3.common.synchronization [req-e7f91a6a-bdb5-4297-ba2e-7f7221989333 req-76c0f462-2f66-493c-a61e-609709b2ebc7 service nova] Enqueued Resource ID: e92d54c2-2104-4901-9fde-ba68a1528dfb with Priority: HIGHEST for action port [ 689.108025] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGHEST for action security_group_rules [ 689.108159] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGHEST for action security_group_members [ 689.108254] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e92d54c2-2104-4901-9fde-ba68a1528dfb with Priority: HIGHEST for action port [ 689.109234] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.109644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.109644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.110986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.110986] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.111822] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.111947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.112024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.112211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.112583] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.112706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.112771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.112927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.113026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.113117] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.113838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e92d54c2-2104-4901-9fde-ba68a1528dfb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.113941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e92d54c2-2104-4901-9fde-ba68a1528dfb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.114277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e92d54c2-2104-4901-9fde-ba68a1528dfb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.114444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e92d54c2-2104-4901-9fde-ba68a1528dfb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.114519] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e92d54c2-2104-4901-9fde-ba68a1528dfb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.346519] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4ac19ad-e539-4704-bca2-e91f66ad37cc req-48b209d6-e964-442a-bf51-380929606127 tempest-VolumesAssistedSnapshotsTest-737708639 tempest-VolumesAssistedSnapshotsTest-737708639-project-member] Enqueued Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_members [ 689.347098] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_members [ 689.347404] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3790264b-87dd-4660-b7c5-8d4dc98f1500 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.347550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.347613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.347858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.349997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.350201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.350274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.350498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.350590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.350693] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.616325] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.617837] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.617962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.618141] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e92d54c2-2104-4901-9fde-ba68a1528dfb with status ACTIVE [ 689.618302] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.618411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.618473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.618689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.618806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.620534] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.620742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.620867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.621179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.621343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.621704] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.621847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.621966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.622245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.622443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.622559] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e92d54c2-2104-4901-9fde-ba68a1528dfb is going to be updated. [ 689.650511] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.650649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.650713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.651530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.651795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.652042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e92d54c2-2104-4901-9fde-ba68a1528dfb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.854023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.854293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.854293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.854443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.857797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.857797] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.857797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.857797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.857797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.857797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.857797] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 already deleted. [ 689.857797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.035500] env[69358]: INFO networking_nsxv3.common.synchronization [None req-b8a9cc84-39a1-4370-845a-18c77629be36 None None] Enqueued Resource ID: 879e524e-a931-4652-8701-309ec8ed15bc with Priority: HIGHEST for action port [ 690.038145] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879e524e-a931-4652-8701-309ec8ed15bc with Priority: HIGHEST for action port [ 690.038550] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-879e524e-a931-4652-8701-309ec8ed15bc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.038796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-879e524e-a931-4652-8701-309ec8ed15bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.038876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-879e524e-a931-4652-8701-309ec8ed15bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.039147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-879e524e-a931-4652-8701-309ec8ed15bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.039241] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('879e524e-a931-4652-8701-309ec8ed15bc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.113847] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.114068] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-736" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.114234] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-736" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.114568] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-736" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.115795] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.115795] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.115795] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.115795] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.115795] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.116021] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.116128] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.116321] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.116974] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.117238] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.117443] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.117566] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.131407] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.143793] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.144066] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.144275] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.144526] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-736" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.144961] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-68719715-aed8-41da-b5a8-f7435778f4f7 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.145229] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-68719715-aed8-41da-b5a8-f7435778f4f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.145410] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-68719715-aed8-41da-b5a8-f7435778f4f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.145852] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-68719715-aed8-41da-b5a8-f7435778f4f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.148204] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68719715-aed8-41da-b5a8-f7435778f4f7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.543172] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 879e524e-a931-4652-8701-309ec8ed15bc [ 690.543172] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.543172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.543172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.543172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.543172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.543172] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:879e524e-a931-4652-8701-309ec8ed15bc already deleted. [ 690.543172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-879e524e-a931-4652-8701-309ec8ed15bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.641070] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.641070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.641070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.641261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.641261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.641907] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 is going to be created. [ 690.651597] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.651827] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.651981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.652305] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.652464] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.652618] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 68719715-aed8-41da-b5a8-f7435778f4f7 not found, creating... [ 690.652905] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.653086] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.653217] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.653436] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.653572] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.653852] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.654016] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.654820] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.655098] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.655268] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.656043] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 68719715-aed8-41da-b5a8-f7435778f4f7 is going to be created. [ 690.669886] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.670205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.670205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.670419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.670587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.677618] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.677829] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.677957] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.678312] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.678508] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.682336] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-68719715-aed8-41da-b5a8-f7435778f4f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.683829] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 in Status: UNINITIALIZED for 2s [ 690.836386] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: SUCCESS [ 690.836693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.852791] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4ac19ad-e539-4704-bca2-e91f66ad37cc req-c2a44090-1634-42e1-a765-62521a4f3906 service nova] Enqueued Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_rules [ 691.853043] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4ac19ad-e539-4704-bca2-e91f66ad37cc req-c2a44090-1634-42e1-a765-62521a4f3906 service nova] Enqueued Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_members [ 691.853132] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4ac19ad-e539-4704-bca2-e91f66ad37cc req-c2a44090-1634-42e1-a765-62521a4f3906 service nova] Enqueued Resource ID: 68719715-aed8-41da-b5a8-f7435778f4f7 with Priority: HIGHEST for action port [ 691.853359] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_rules [ 691.853481] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_members [ 691.853571] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68719715-aed8-41da-b5a8-f7435778f4f7 with Priority: HIGHEST for action port [ 691.854961] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3790264b-87dd-4660-b7c5-8d4dc98f1500 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.855207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.859019] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.859019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3790264b-87dd-4660-b7c5-8d4dc98f1500 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.859019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.859019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.859019] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.860305] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-68719715-aed8-41da-b5a8-f7435778f4f7 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.860469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68719715-aed8-41da-b5a8-f7435778f4f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.860585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68719715-aed8-41da-b5a8-f7435778f4f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.860927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68719715-aed8-41da-b5a8-f7435778f4f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.861053] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68719715-aed8-41da-b5a8-f7435778f4f7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.212133] env[69358]: INFO networking_nsxv3.common.synchronization [None req-98380438-7259-4c5b-b628-5d636f3311f0 None None] Enqueued Resource ID: 25fa4e6e-e5f4-4285-9696-42c4f3853659 with Priority: HIGHEST for action port [ 692.212718] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25fa4e6e-e5f4-4285-9696-42c4f3853659 with Priority: HIGHEST for action port [ 692.214166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-25fa4e6e-e5f4-4285-9696-42c4f3853659 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.214314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25fa4e6e-e5f4-4285-9696-42c4f3853659" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.214388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25fa4e6e-e5f4-4285-9696-42c4f3853659" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.214851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25fa4e6e-e5f4-4285-9696-42c4f3853659" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.214851] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25fa4e6e-e5f4-4285-9696-42c4f3853659',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.365220] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68719715-aed8-41da-b5a8-f7435778f4f7 with status ACTIVE [ 692.367152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.367152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.367152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.367152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.367152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.367152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.367152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.367152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.367152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.367491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.367491] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.367670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.367670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.367968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.368276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.368506] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68719715-aed8-41da-b5a8-f7435778f4f7 is going to be updated. [ 692.370891] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3790264b-87dd-4660-b7c5-8d4dc98f1500 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.370891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.371255] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.389987] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.390219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.390219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.390425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.390556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.390727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68719715-aed8-41da-b5a8-f7435778f4f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.437764] env[69358]: INFO networking_nsxv3.common.synchronization [None req-7dbef012-80fd-4ee1-90f6-db2d84116c5a None None] Enqueued Resource ID: 06ea86df-4bfa-4731-9063-31c4aae4abcc with Priority: HIGHEST for action port [ 692.438413] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06ea86df-4bfa-4731-9063-31c4aae4abcc with Priority: HIGHEST for action port [ 692.438610] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-06ea86df-4bfa-4731-9063-31c4aae4abcc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.438771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06ea86df-4bfa-4731-9063-31c4aae4abcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.438807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06ea86df-4bfa-4731-9063-31c4aae4abcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.439090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06ea86df-4bfa-4731-9063-31c4aae4abcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.439143] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ea86df-4bfa-4731-9063-31c4aae4abcc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.696876] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 in Status: SUCCESS [ 692.696876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.696876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.696876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.696876] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.696876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.696876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.696876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.696876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.696876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.696876] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.721907] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25fa4e6e-e5f4-4285-9696-42c4f3853659 [ 692.721907] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.721907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.721907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.722118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.722211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.722432] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25fa4e6e-e5f4-4285-9696-42c4f3853659 already deleted. [ 692.722432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25fa4e6e-e5f4-4285-9696-42c4f3853659" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.876152] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.946981] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06ea86df-4bfa-4731-9063-31c4aae4abcc [ 692.946981] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.946981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.946981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.946981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.946981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.946981] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06ea86df-4bfa-4731-9063-31c4aae4abcc already deleted. [ 692.946981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06ea86df-4bfa-4731-9063-31c4aae4abcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.204011] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.204011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.204011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207828] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.380898] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.380898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.380898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.380898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.380898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.380898] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 is going to be created. [ 693.403439] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.403439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.403439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.403439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.403439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.414352] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 in Status: UNINITIALIZED for 2s [ 693.643703] env[69358]: INFO networking_nsxv3.common.synchronization [req-e31f791b-7b32-4a3d-84c8-a262da0706ec req-1f32c1cb-332e-43f7-9550-bcbcce9d0eb3 tempest-SecurityGroupRulesTestJSON-370587668 tempest-SecurityGroupRulesTestJSON-370587668-project-member] Enqueued Resource ID: af156aa5-74d7-4164-92e5-452ebd40894c with Priority: HIGHEST for action security_group_rules [ 693.643703] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af156aa5-74d7-4164-92e5-452ebd40894c with Priority: HIGHEST for action security_group_rules [ 693.644043] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af156aa5-74d7-4164-92e5-452ebd40894c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.644166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.644207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.644435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.644514] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af156aa5-74d7-4164-92e5-452ebd40894c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.712022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe03fb7c-5cc5-4d19-acba-b32df8b792f2: rpc.has_security_group_logging(os_id): False [ 693.731026] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.731026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.731026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.731026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.731026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.731473] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.731473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.731473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.731473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.731618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.731812] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.731914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.731914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.732109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.732192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.732463] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.732537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.732537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.732775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.732775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.732901] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 is going to be created. [ 693.789088] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.789393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.789529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.789918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.790048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.800046] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 in Status: IN_PROGRESS for 2s [ 694.167218] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.167542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.167542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.167765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.167765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.167877] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af156aa5-74d7-4164-92e5-452ebd40894c already deleted. [ 694.167931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.790907] env[69358]: INFO networking_nsxv3.common.synchronization [None req-dda0a933-ff57-4a1f-a66b-9f221e4700ed None None] Enqueued Resource ID: 3abd9448-acf0-477c-8fa2-18a657be87fd with Priority: HIGHEST for action port [ 694.791460] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3abd9448-acf0-477c-8fa2-18a657be87fd with Priority: HIGHEST for action port [ 694.791771] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-3abd9448-acf0-477c-8fa2-18a657be87fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.791930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3abd9448-acf0-477c-8fa2-18a657be87fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.793102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3abd9448-acf0-477c-8fa2-18a657be87fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.793438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3abd9448-acf0-477c-8fa2-18a657be87fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.793531] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3abd9448-acf0-477c-8fa2-18a657be87fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.952429] env[69358]: INFO networking_nsxv3.common.synchronization [None req-4185445b-3369-49f1-aea4-1ba144bfa2fe None None] Enqueued Resource ID: 941b1352-5f22-4006-bdfe-d47d18d20f25 with Priority: HIGHEST for action port [ 694.952674] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 941b1352-5f22-4006-bdfe-d47d18d20f25 with Priority: HIGHEST for action port [ 694.953148] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-941b1352-5f22-4006-bdfe-d47d18d20f25 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.953280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-941b1352-5f22-4006-bdfe-d47d18d20f25" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.953345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-941b1352-5f22-4006-bdfe-d47d18d20f25" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.953682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-941b1352-5f22-4006-bdfe-d47d18d20f25" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.953682] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('941b1352-5f22-4006-bdfe-d47d18d20f25',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.299537] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3abd9448-acf0-477c-8fa2-18a657be87fd [ 695.299537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.299537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.299537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.300017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.300017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.300017] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3abd9448-acf0-477c-8fa2-18a657be87fd already deleted. [ 695.300017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3abd9448-acf0-477c-8fa2-18a657be87fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.436022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 in Status: SUCCESS [ 695.436089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.436275] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.436802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.436899] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.437069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.437140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.437797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.437797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.437797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.437797] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.458481] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 941b1352-5f22-4006-bdfe-d47d18d20f25 [ 695.458481] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.458481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.458481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.458481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.458481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.458481] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:941b1352-5f22-4006-bdfe-d47d18d20f25 already deleted. [ 695.458481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-941b1352-5f22-4006-bdfe-d47d18d20f25" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.706363] env[69358]: INFO networking_nsxv3.common.synchronization [req-2037ef02-c063-4063-8ffe-377819ad4235 req-6b3aa8ac-a2e0-4207-bcfc-d4f6481b5255 tempest-ImagesNegativeTestJSON-1317489390 tempest-ImagesNegativeTestJSON-1317489390-project-member] Enqueued Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGHEST for action security_group_members [ 695.708157] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGHEST for action security_group_members [ 695.708157] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1dcd4d-bf87-416a-a453-7eff939b6bce taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.708157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.708157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.708157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.708157] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.708653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.708712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.709040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.709040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.709286] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.809212] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 in Status: SUCCESS [ 695.810214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.942823] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.215333] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.216221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.216221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.216221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.216480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.217272] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.217272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.217272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.217272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.217272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.217272] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce already deleted. [ 696.217272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.311555] env[69358]: INFO networking_nsxv3.common.synchronization [req-647e0571-9a94-406c-97f5-c6d8018e95dc req-6c70895d-7e32-4e22-b5b4-2031f9378bc5 tempest-SecurityGroupRulesTestJSON-370587668 tempest-SecurityGroupRulesTestJSON-370587668-project-member] Enqueued Resource ID: af156aa5-74d7-4164-92e5-452ebd40894c with Priority: HIGHEST for action security_group_rules [ 696.311555] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af156aa5-74d7-4164-92e5-452ebd40894c with Priority: HIGHEST for action security_group_rules [ 696.311555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af156aa5-74d7-4164-92e5-452ebd40894c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.313052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.313052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.313052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.313052] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af156aa5-74d7-4164-92e5-452ebd40894c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.446441] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3790264b-87dd-4660-b7c5-8d4dc98f1500: rpc.has_security_group_logging(os_id): False [ 696.466564] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.466564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.466564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.466564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.466564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.466853] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.466853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.466853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.467040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.467265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.468512] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 is going to be created. [ 696.525239] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.525595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.525595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.526121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.526121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.536150] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 in Status: IN_PROGRESS for 2s [ 696.770553] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.770553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-595" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.770553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-595" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.770553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-595" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.770553] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.770553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.770960] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.770960] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.771111] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.773065] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.773065] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.773065] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.773065] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.773065] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.773065] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.773065] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.799051] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.799184] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.799322] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.800355] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-595" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.800960] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-8349bb84-f1ec-4d4b-8783-f016859026ed taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.800960] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-8349bb84-f1ec-4d4b-8783-f016859026ed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.801141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-8349bb84-f1ec-4d4b-8783-f016859026ed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.801332] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-8349bb84-f1ec-4d4b-8783-f016859026ed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.801467] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8349bb84-f1ec-4d4b-8783-f016859026ed',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.840136] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.840136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.840136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.840453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.840453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.840453] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af156aa5-74d7-4164-92e5-452ebd40894c already deleted. [ 696.840568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.293606] env[69358]: INFO networking_nsxv3.common.synchronization [None req-fe4773c7-f6f5-4d26-86a1-1afca1a899e6 None None] Enqueued Resource ID: e8d281a1-a3a3-4eef-939d-c22298fc6c7d with Priority: HIGHEST for action port [ 697.294353] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8d281a1-a3a3-4eef-939d-c22298fc6c7d with Priority: HIGHEST for action port [ 697.295858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8d281a1-a3a3-4eef-939d-c22298fc6c7d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.295858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8d281a1-a3a3-4eef-939d-c22298fc6c7d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.295858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8d281a1-a3a3-4eef-939d-c22298fc6c7d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.296131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8d281a1-a3a3-4eef-939d-c22298fc6c7d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.296131] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8d281a1-a3a3-4eef-939d-c22298fc6c7d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.306602] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.307063] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.307726] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.308343] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.308541] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.308740] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 8349bb84-f1ec-4d4b-8783-f016859026ed not found, creating... [ 697.309067] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.309276] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.309515] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.311193] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.311193] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.311193] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.311193] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.311193] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.311193] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.311193] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.311193] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 8349bb84-f1ec-4d4b-8783-f016859026ed is going to be created. [ 697.332092] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.332092] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.332463] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.332501] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.333625] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.333625] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-8349bb84-f1ec-4d4b-8783-f016859026ed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.800141] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8d281a1-a3a3-4eef-939d-c22298fc6c7d [ 697.800405] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.800541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.800609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.800865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.800963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.801120] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8d281a1-a3a3-4eef-939d-c22298fc6c7d already deleted. [ 697.801166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8d281a1-a3a3-4eef-939d-c22298fc6c7d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.939186] env[69358]: INFO networking_nsxv3.common.synchronization [req-de604e57-b12d-4226-84ea-eb7548bdd9ad req-f9e3736a-574f-4e4a-a1bd-c8cf4a19e88f tempest-ListServerFiltersTestJSON-1173311410 tempest-ListServerFiltersTestJSON-1173311410-project-member] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 697.939941] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 697.940908] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.941106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.941944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.942673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.942872] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.943208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.943312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.944444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.944444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.944444] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.178506] env[69358]: INFO networking_nsxv3.common.synchronization [req-2037ef02-c063-4063-8ffe-377819ad4235 req-bcf4c8b2-2f78-4a00-acb1-35dd73759670 service nova] Enqueued Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGHEST for action security_group_rules [ 698.178506] env[69358]: INFO networking_nsxv3.common.synchronization [req-2037ef02-c063-4063-8ffe-377819ad4235 req-bcf4c8b2-2f78-4a00-acb1-35dd73759670 service nova] Enqueued Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGHEST for action security_group_members [ 698.178506] env[69358]: INFO networking_nsxv3.common.synchronization [req-2037ef02-c063-4063-8ffe-377819ad4235 req-bcf4c8b2-2f78-4a00-acb1-35dd73759670 service nova] Enqueued Resource ID: 8349bb84-f1ec-4d4b-8783-f016859026ed with Priority: HIGHEST for action port [ 698.178506] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGHEST for action security_group_rules [ 698.178506] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGHEST for action security_group_members [ 698.178506] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8349bb84-f1ec-4d4b-8783-f016859026ed with Priority: HIGHEST for action port [ 698.180749] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.181010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.181010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.181197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.181301] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.182955] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1dcd4d-bf87-416a-a453-7eff939b6bce taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.183099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.183163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.183583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.183796] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.183911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.183987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.185398] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.185398] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.185398] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.188022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-8349bb84-f1ec-4d4b-8783-f016859026ed taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.188022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8349bb84-f1ec-4d4b-8783-f016859026ed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.188022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8349bb84-f1ec-4d4b-8783-f016859026ed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.188022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8349bb84-f1ec-4d4b-8783-f016859026ed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.188408] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8349bb84-f1ec-4d4b-8783-f016859026ed',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.447557] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.447988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.447988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.448261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.448358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.448643] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.448807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.448901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.449136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.449256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.449350] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 already deleted. [ 698.449462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.548645] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 in Status: SUCCESS [ 698.549867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.670078] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.670296] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.670423] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.670949] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.671059] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.671220] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.671338] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.671561] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.674825] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.675078] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.676229] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.676229] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.676229] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.676229] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.676229] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.676229] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.683407] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1dcd4d-bf87-416a-a453-7eff939b6bce taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.683682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.688702] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.693248] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.693369] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.693514] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.693694] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.694503] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.694773] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.695159] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.695691] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.695907] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('981d689b-9821-4fb1-9d3a-c4b41e14a7eb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.697347] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8349bb84-f1ec-4d4b-8783-f016859026ed with status ACTIVE [ 698.697591] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.697785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.697871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.698093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.698211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.698388] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.698512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.698580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.698737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.698830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.699407] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.699574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.699800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.699971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.700309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.700407] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8349bb84-f1ec-4d4b-8783-f016859026ed is going to be updated. [ 698.721071] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.721479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.721581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.721788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.722093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.722093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8349bb84-f1ec-4d4b-8783-f016859026ed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.157464] env[69358]: INFO networking_nsxv3.common.synchronization [req-08b8a1d6-8303-4d02-bfd7-8493441f26eb req-e6a28c7e-9d29-47ab-965a-98cb8af0e5d7 tempest-SecurityGroupRulesTestJSON-370587668 tempest-SecurityGroupRulesTestJSON-370587668-project-member] Enqueued Resource ID: af156aa5-74d7-4164-92e5-452ebd40894c with Priority: HIGHEST for action security_group_rules [ 699.157464] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af156aa5-74d7-4164-92e5-452ebd40894c with Priority: HIGHEST for action security_group_rules [ 699.157464] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af156aa5-74d7-4164-92e5-452ebd40894c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.157464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.157464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.159302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.159426] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af156aa5-74d7-4164-92e5-452ebd40894c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.191154] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.203803] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.203803] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.203994] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.204141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.204294] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.204455] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 981d689b-9821-4fb1-9d3a-c4b41e14a7eb not found, creating... [ 699.204726] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.204884] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.205037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.205224] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.205358] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.205632] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.205784] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.205907] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.206343] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.206491] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.206633] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 981d689b-9821-4fb1-9d3a-c4b41e14a7eb is going to be created. [ 699.227922] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.228170] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.228297] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.228587] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.228823] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.229054] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.302219] env[69358]: INFO networking_nsxv3.common.synchronization [None req-a3bba2a1-05ff-4492-8f14-ad335077b861 None None] Enqueued Resource ID: fb8e1912-b497-4366-a896-fe44d9747caf with Priority: HIGHEST for action port [ 699.303602] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb8e1912-b497-4366-a896-fe44d9747caf with Priority: HIGHEST for action port [ 699.303948] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb8e1912-b497-4366-a896-fe44d9747caf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.305267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb8e1912-b497-4366-a896-fe44d9747caf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.305353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb8e1912-b497-4366-a896-fe44d9747caf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.305649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb8e1912-b497-4366-a896-fe44d9747caf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.305789] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb8e1912-b497-4366-a896-fe44d9747caf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.680476] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.680807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.680807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.680807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.680807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.681209] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af156aa5-74d7-4164-92e5-452ebd40894c already deleted. [ 699.681209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af156aa5-74d7-4164-92e5-452ebd40894c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.692807] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.693283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.693401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.693708] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.693800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.693919] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce is going to be created. [ 699.721545] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.721545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.721912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.722300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.722449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.733382] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce in Status: UNINITIALIZED for 2s [ 699.813935] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb8e1912-b497-4366-a896-fe44d9747caf [ 699.814239] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.814364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.814414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.814991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.814991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.814991] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb8e1912-b497-4366-a896-fe44d9747caf already deleted. [ 699.814991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb8e1912-b497-4366-a896-fe44d9747caf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.243943] env[69358]: INFO networking_nsxv3.common.synchronization [req-de604e57-b12d-4226-84ea-eb7548bdd9ad req-5e8716e3-87c6-4d44-8314-79f1048cd56c service nova] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_rules [ 700.244819] env[69358]: INFO networking_nsxv3.common.synchronization [req-de604e57-b12d-4226-84ea-eb7548bdd9ad req-5e8716e3-87c6-4d44-8314-79f1048cd56c service nova] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 700.244819] env[69358]: INFO networking_nsxv3.common.synchronization [req-de604e57-b12d-4226-84ea-eb7548bdd9ad req-5e8716e3-87c6-4d44-8314-79f1048cd56c service nova] Enqueued Resource ID: 981d689b-9821-4fb1-9d3a-c4b41e14a7eb with Priority: HIGHEST for action port [ 700.245287] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_rules [ 700.245516] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 700.245754] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981d689b-9821-4fb1-9d3a-c4b41e14a7eb with Priority: HIGHEST for action port [ 700.247442] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.248144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.248144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.249256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.249256] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.251615] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.251750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.252284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.252284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.252284] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.252535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.252535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.252919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.252919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.252919] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.257064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.257064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.257064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.257064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.257064] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('981d689b-9821-4fb1-9d3a-c4b41e14a7eb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.559183] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ba36faa5-fe06-4893-aad2-76357e302ef9 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_rules [ 700.559183] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_rules [ 700.559183] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.559183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.559183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.560041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.560088] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.756346] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.760673] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.760989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.761285] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 981d689b-9821-4fb1-9d3a-c4b41e14a7eb with status ACTIVE [ 700.761521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.761669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.761756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.762011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.762280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.762624] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.762624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.762624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.762868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.762915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.763213] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.763304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.763343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.763506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.763607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.763695] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 981d689b-9821-4fb1-9d3a-c4b41e14a7eb is going to be updated. [ 700.777639] env[69358]: INFO networking_nsxv3.common.synchronization [None req-996bece1-ccb5-4c8f-a82a-1b947f9faf43 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_rules [ 700.778777] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_rules [ 700.779202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.779391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.785474] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.785688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.785722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.785936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.786097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.789054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-981d689b-9821-4fb1-9d3a-c4b41e14a7eb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.037421] env[69358]: INFO networking_nsxv3.common.synchronization [None req-1be38bb3-9d51-4feb-a7e1-b65bbdb12b1d None None] Enqueued Resource ID: 32361484-f94d-4613-85e9-51ff25892909 with Priority: HIGHEST for action port [ 701.038144] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32361484-f94d-4613-85e9-51ff25892909 with Priority: HIGHEST for action port [ 701.038819] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-32361484-f94d-4613-85e9-51ff25892909 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.039647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32361484-f94d-4613-85e9-51ff25892909" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.039771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32361484-f94d-4613-85e9-51ff25892909" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.040142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32361484-f94d-4613-85e9-51ff25892909" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.040234] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32361484-f94d-4613-85e9-51ff25892909',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.083022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.083022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.083022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.083022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.083022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.083022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 already deleted. [ 701.083022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.083022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.083022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.083022] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.262469] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.547028] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32361484-f94d-4613-85e9-51ff25892909 [ 701.547028] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.547028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.547028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.547028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.547028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.547028] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32361484-f94d-4613-85e9-51ff25892909 already deleted. [ 701.547028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32361484-f94d-4613-85e9-51ff25892909" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.601966] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.604212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.604212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.604212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.604212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.604212] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 already deleted. [ 701.604212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.746299] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce in Status: SUCCESS [ 701.746518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.746694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.747520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.747520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.747520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.747520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.747520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.747520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.747795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.747855] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.764990] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.765557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.765600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.765832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.765928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.766049] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be created. [ 701.793119] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.793119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.793119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.793119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.793119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.814291] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: UNINITIALIZED for 2s [ 702.252781] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1dcd4d-bf87-416a-a453-7eff939b6bce taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.252929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.252929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.253182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.253357] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.253541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.253541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.253664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.254395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.254395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.254395] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1dcd4d-bf87-416a-a453-7eff939b6bce taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.254395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.254395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.254395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.254395] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.254730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.254730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.254730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.254730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.254945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.254945] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.761418] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1dcd4d-bf87-416a-a453-7eff939b6bce: rpc.has_security_group_logging(os_id): False [ 702.777858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.778206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.778250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.779093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.779093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.779093] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.779093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.779093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.779093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.779500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.779500] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.779500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.779500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.779645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.779682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.782232] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.782232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.782232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.782232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.782232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.782232] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce is going to be created. [ 702.844893] env[69358]: INFO networking_nsxv3.common.synchronization [req-8e7c24fc-87ad-4336-8743-7c28cbfbd667 req-2005d9b5-aead-45db-bc71-8babb159eaff tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 702.847051] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.847051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.847716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.848060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.848293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.850124] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 702.850498] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.850669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.850789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.851977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.852240] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.852372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.852437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.852618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.853512] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.870139] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce in Status: IN_PROGRESS for 2s [ 703.356095] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.356254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.356359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.356538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.356628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.356818] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.356957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.356957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.357164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.357223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.357269] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 already deleted. [ 703.357344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.823042] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 703.823042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.823422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.823422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.823865] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.824035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.824243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.824419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.824517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.824609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.825424] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.953938] env[69358]: INFO networking_nsxv3.common.synchronization [None req-173a8d78-8e75-406f-b39f-87663244dd01 None None] Enqueued Resource ID: 995b4739-4898-4f10-b47b-92f18df73760 with Priority: HIGHEST for action port [ 703.954681] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 995b4739-4898-4f10-b47b-92f18df73760 with Priority: HIGHEST for action port [ 703.955351] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-995b4739-4898-4f10-b47b-92f18df73760 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.956011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-995b4739-4898-4f10-b47b-92f18df73760" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.956011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-995b4739-4898-4f10-b47b-92f18df73760" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.956011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-995b4739-4898-4f10-b47b-92f18df73760" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.956011] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995b4739-4898-4f10-b47b-92f18df73760',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.020671] env[69358]: INFO networking_nsxv3.common.synchronization [None req-0d100ab2-ca60-41af-8d24-c04c74455e98 None None] Enqueued Resource ID: db9617ce-0290-4311-8690-8f343f79f82b with Priority: HIGHEST for action port [ 704.020724] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9617ce-0290-4311-8690-8f343f79f82b with Priority: HIGHEST for action port [ 704.022413] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-db9617ce-0290-4311-8690-8f343f79f82b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.023998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db9617ce-0290-4311-8690-8f343f79f82b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.023998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db9617ce-0290-4311-8690-8f343f79f82b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.023998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db9617ce-0290-4311-8690-8f343f79f82b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.023998] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db9617ce-0290-4311-8690-8f343f79f82b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.038197] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.038197] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.038197] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.038197] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.038197] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.038610] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.038802] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.039086] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.039430] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.040226] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.040320] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.040456] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.040569] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.041960] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.041960] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.041960] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.061272] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.061447] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.061587] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.061799] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.062162] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-6cffb9e1-945a-4ed3-b552-873688e86edc taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.062408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-6cffb9e1-945a-4ed3-b552-873688e86edc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.062498] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-6cffb9e1-945a-4ed3-b552-873688e86edc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.062890] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-6cffb9e1-945a-4ed3-b552-873688e86edc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.063084] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cffb9e1-945a-4ed3-b552-873688e86edc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.330768] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.330969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.331044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.331311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.331481] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.331592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.331647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.335118] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.335118] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.335118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.335118] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.458219] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 995b4739-4898-4f10-b47b-92f18df73760 [ 704.458639] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.458965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.460014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.460347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.460530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.460724] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:995b4739-4898-4f10-b47b-92f18df73760 already deleted. [ 704.460894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-995b4739-4898-4f10-b47b-92f18df73760" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.527276] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db9617ce-0290-4311-8690-8f343f79f82b [ 704.527731] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.528396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.528581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.528912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.529544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.529544] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db9617ce-0290-4311-8690-8f343f79f82b already deleted. [ 704.529544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db9617ce-0290-4311-8690-8f343f79f82b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.567056] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.567056] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.567290] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.567788] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.567788] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.567788] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 6cffb9e1-945a-4ed3-b552-873688e86edc not found, creating... [ 704.568253] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.568253] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.568411] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.568710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.568710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.570029] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.570029] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.570029] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.570029] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.570029] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.570029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 6cffb9e1-945a-4ed3-b552-873688e86edc is going to be created. [ 704.591230] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.591230] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.591230] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.591230] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.591463] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.591610] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-6cffb9e1-945a-4ed3-b552-873688e86edc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.798193] env[69358]: INFO networking_nsxv3.common.synchronization [req-88492b69-8ebe-4b2d-a70d-04fc09a25508 req-fd651ae6-15d2-49e0-96cf-8aa3492b630e tempest-InstanceActionsV221TestJSON-421179459 tempest-InstanceActionsV221TestJSON-421179459-project-member] Enqueued Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGHEST for action security_group_members [ 704.798193] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGHEST for action security_group_members [ 704.798193] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.798193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.798755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.799072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.799475] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.799730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.799940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.800323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.800599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.802255] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.837853] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd2c3b18-33a0-460a-a199-3124440c68e8: rpc.has_security_group_logging(os_id): False [ 704.856070] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.856250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.856250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.856572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.857433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.857433] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.857433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.857433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.857433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.857433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.857633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.858046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.858046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.858046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.859258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.862310] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.862310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.862310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.862310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.862310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.862310] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be created. [ 704.882839] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce in Status: SUCCESS [ 704.882839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.930167] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.930167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.930167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.930167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.930167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.942336] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 705.305888] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.306149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.306206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.306447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.306598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.306796] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.306911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.306978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.307168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.307308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.307344] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 is going to be updated. [ 705.346536] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.347233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.347759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.348043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.348260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.359219] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 in Status: IN_PROGRESS for 2s [ 705.619589] env[69358]: INFO networking_nsxv3.common.synchronization [req-8e7c24fc-87ad-4336-8743-7c28cbfbd667 req-f3aa10a8-f9cf-4a17-8f75-68e8d4b12552 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 705.619729] env[69358]: INFO networking_nsxv3.common.synchronization [req-8e7c24fc-87ad-4336-8743-7c28cbfbd667 req-f3aa10a8-f9cf-4a17-8f75-68e8d4b12552 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 705.619797] env[69358]: INFO networking_nsxv3.common.synchronization [req-8e7c24fc-87ad-4336-8743-7c28cbfbd667 req-f3aa10a8-f9cf-4a17-8f75-68e8d4b12552 service nova] Enqueued Resource ID: 6cffb9e1-945a-4ed3-b552-873688e86edc with Priority: HIGHEST for action port [ 705.620059] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 705.620219] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 705.620372] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cffb9e1-945a-4ed3-b552-873688e86edc with Priority: HIGHEST for action port [ 705.620965] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.623454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.623454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.623454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.623454] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.624264] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.624481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.624481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.624634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.624789] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.624877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.624931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.625143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.625196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.625268] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.626358] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cffb9e1-945a-4ed3-b552-873688e86edc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.626543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cffb9e1-945a-4ed3-b552-873688e86edc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.626655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cffb9e1-945a-4ed3-b552-873688e86edc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.626886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cffb9e1-945a-4ed3-b552-873688e86edc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.627017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cffb9e1-945a-4ed3-b552-873688e86edc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.822121] env[69358]: INFO networking_nsxv3.common.synchronization [req-0644443b-9056-46e6-9651-69ffbee73429 req-8f20c212-f534-4e24-a63e-0a5ce72c30df tempest-ServersTestManualDisk-96811625 tempest-ServersTestManualDisk-96811625-project-member] Enqueued Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_members [ 705.824152] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_members [ 705.824152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9495602c-f01c-4935-941b-dacd2d1ea667 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.824152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.824152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.824152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.824152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.824152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.824152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.824678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.824855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.825043] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.128562] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.132084] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.132084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.132084] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6cffb9e1-945a-4ed3-b552-873688e86edc with status ACTIVE [ 706.132084] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.132084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.132084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.132084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.132084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.132084] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.136803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.136803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.136803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.136803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.136803] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.136803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.136803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.136803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.136803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.136803] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6cffb9e1-945a-4ed3-b552-873688e86edc is going to be updated. [ 706.156307] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.156644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.156792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.157024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.157205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.157391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cffb9e1-945a-4ed3-b552-873688e86edc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.328450] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.328450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.328450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.329048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.329048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.329048] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.329048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.329048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.329246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.329246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.329307] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9495602c-f01c-4935-941b-dacd2d1ea667 already deleted. [ 706.330430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.441449] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-491 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.441642] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-491" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.441762] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-491" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.442117] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-491" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.442465] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.442600] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.442659] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.442838] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.442981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.451820] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.451925] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.451984] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.452085] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.452206] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.452342] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.452515] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.470230] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.470368] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.470510] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.470696] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-491" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.471049] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-31937717-5f62-46d4-b82e-68302061236e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.471263] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-31937717-5f62-46d4-b82e-68302061236e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.471431] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-31937717-5f62-46d4-b82e-68302061236e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.471801] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-31937717-5f62-46d4-b82e-68302061236e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.471962] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31937717-5f62-46d4-b82e-68302061236e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.502880] env[69358]: INFO networking_nsxv3.common.synchronization [None req-9d69ba79-c655-45f2-8709-961bb81cc409 None None] Enqueued Resource ID: a01c3b2a-5653-46c3-9a8a-cb3b941eefbe with Priority: HIGHEST for action port [ 706.504410] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a01c3b2a-5653-46c3-9a8a-cb3b941eefbe with Priority: HIGHEST for action port [ 706.504726] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a01c3b2a-5653-46c3-9a8a-cb3b941eefbe taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.504874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a01c3b2a-5653-46c3-9a8a-cb3b941eefbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.504969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a01c3b2a-5653-46c3-9a8a-cb3b941eefbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.505295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a01c3b2a-5653-46c3-9a8a-cb3b941eefbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.505480] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a01c3b2a-5653-46c3-9a8a-cb3b941eefbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.631876] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.958036] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 706.958036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.975030] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.975404] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.975597] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.975909] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.976129] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.976337] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 31937717-5f62-46d4-b82e-68302061236e not found, creating... [ 706.976639] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.976845] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.976997] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.977273] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.978032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.978032] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.978032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.978032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.981951] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.982131] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.982279] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 31937717-5f62-46d4-b82e-68302061236e is going to be created. [ 707.002777] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.002984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.003279] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.004506] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.004506] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.004506] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-31937717-5f62-46d4-b82e-68302061236e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.009598] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a01c3b2a-5653-46c3-9a8a-cb3b941eefbe [ 707.009598] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.009598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.009598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.009598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.009598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.009598] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a01c3b2a-5653-46c3-9a8a-cb3b941eefbe already deleted. [ 707.009598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a01c3b2a-5653-46c3-9a8a-cb3b941eefbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.136048] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.136438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.136438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.136550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.136602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.137397] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be created. [ 707.170089] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.170289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.170333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.170562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.170759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.179342] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: UNINITIALIZED for 2s [ 707.369577] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 in Status: SUCCESS [ 707.369577] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 deletion is rescheduled due to dependency. [ 707.369577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.891406] env[69358]: INFO networking_nsxv3.common.synchronization [req-0644443b-9056-46e6-9651-69ffbee73429 req-a4fe3b2f-9814-46d1-ac15-255bb963ea6e service nova] Enqueued Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_rules [ 707.891406] env[69358]: INFO networking_nsxv3.common.synchronization [req-0644443b-9056-46e6-9651-69ffbee73429 req-a4fe3b2f-9814-46d1-ac15-255bb963ea6e service nova] Enqueued Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_members [ 707.891406] env[69358]: INFO networking_nsxv3.common.synchronization [req-0644443b-9056-46e6-9651-69ffbee73429 req-a4fe3b2f-9814-46d1-ac15-255bb963ea6e service nova] Enqueued Resource ID: 31937717-5f62-46d4-b82e-68302061236e with Priority: HIGHEST for action port [ 707.891406] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_rules [ 707.891406] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_members [ 707.891822] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31937717-5f62-46d4-b82e-68302061236e with Priority: HIGHEST for action port [ 707.892212] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9495602c-f01c-4935-941b-dacd2d1ea667 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.892377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.892557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.892619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.893299] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.894110] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9495602c-f01c-4935-941b-dacd2d1ea667 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.894110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.894110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.894110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.894110] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.894767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.894838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.895030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.895124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.895218] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.895957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-31937717-5f62-46d4-b82e-68302061236e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.896080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31937717-5f62-46d4-b82e-68302061236e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.896148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31937717-5f62-46d4-b82e-68302061236e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.896303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31937717-5f62-46d4-b82e-68302061236e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.896376] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31937717-5f62-46d4-b82e-68302061236e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.398590] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9495602c-f01c-4935-941b-dacd2d1ea667 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.399024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.399024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31937717-5f62-46d4-b82e-68302061236e with status ACTIVE [ 708.399122] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.399188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.399259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.399472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.399645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.399835] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.399890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.400195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.400397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.400484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.400682] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.400825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.400886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.401070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.401151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.401236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31937717-5f62-46d4-b82e-68302061236e is going to be updated. [ 708.402386] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.424513] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.424513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.424513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.424513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.424513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.424513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31937717-5f62-46d4-b82e-68302061236e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.904879] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.194265] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 709.194539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.194997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.196167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.196381] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.196526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.196595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.196767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.196849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.196938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.197044] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.409393] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.409746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.409746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.409939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.410423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.410423] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9495602c-f01c-4935-941b-dacd2d1ea667 is going to be created. [ 709.435650] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.435817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.435892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.436106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.436276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.444910] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9495602c-f01c-4935-941b-dacd2d1ea667 in Status: UNINITIALIZED for 2s [ 709.701610] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.701837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.701910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.702137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.702334] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.702730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.702730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.702730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.702881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.703041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.703185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.703292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.703383] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.703583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.704229] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.704229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.704229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.704229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.704493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.704493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.704560] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.210707] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 710.233022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.233022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.233022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.233022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.237409] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.237409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.237409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.237409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.237409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.237409] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be created. [ 710.306784] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.306784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.306784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.306784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.306784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.322927] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 711.214032] env[69358]: INFO networking_nsxv3.common.synchronization [req-c742d610-a0ae-4761-afe2-d90d4bae1fb8 req-3746bbf2-2e55-498c-9dad-baece3edae45 tempest-InstanceActionsNegativeTestJSON-1309089097 tempest-InstanceActionsNegativeTestJSON-1309089097-project-member] Enqueued Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGHEST for action security_group_members [ 711.214485] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGHEST for action security_group_members [ 711.214783] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ab349f-7df0-40a9-a595-1a8e298f956a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.214960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.214960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.219483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.219483] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.219483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.219483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.219483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.219483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.219483] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.454691] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9495602c-f01c-4935-941b-dacd2d1ea667 in Status: SUCCESS [ 711.454929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.455115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.455349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.455560] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.455681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.455746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.455953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.456103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.456247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.456393] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.633918] env[69358]: INFO networking_nsxv3.common.synchronization [req-72cd4f6b-1beb-4187-8ddc-e13f8d4af23d req-f4372d1a-813c-4135-8d6d-c23e78ff62ab tempest-ImagesOneServerNegativeTestJSON-962105235 tempest-ImagesOneServerNegativeTestJSON-962105235-project-member] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 711.635308] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 711.636905] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.636979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.637091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.638831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.638831] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.638831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.638831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.638831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.638831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.638831] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.723114] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.723265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.723344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.723590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.723695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.723880] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.723988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.724067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.724313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.724353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.724447] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ab349f-7df0-40a9-a595-1a8e298f956a already deleted. [ 711.724504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.778026] env[69358]: INFO networking_nsxv3.common.synchronization [req-b2ca9d99-be28-4ad8-b28e-fa7b060bd4f0 req-e4febc22-de23-4930-877b-7191a6d893fa tempest-ImagesNegativeTestJSON-1317489390 tempest-ImagesNegativeTestJSON-1317489390-project-member] Enqueued Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGHEST for action security_group_members [ 711.781183] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGHEST for action security_group_members [ 711.781183] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1dcd4d-bf87-416a-a453-7eff939b6bce taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.781183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.781183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.781183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.782283] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.782426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.782426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.782624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.782719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.782832] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.960220] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.062025] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.062025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-845" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.062025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-845" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.062025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-845" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.062025] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.062025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.062025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.062025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.062025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.062025] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.062025] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.062025] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.062025] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.063259] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.063259] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.063259] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.084045] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.084288] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 712.084368] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.084543] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-845" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.084868] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-5ac54556-f024-4852-8395-20ce12413b7e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.085061] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-5ac54556-f024-4852-8395-20ce12413b7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.085183] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-5ac54556-f024-4852-8395-20ce12413b7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.085518] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-5ac54556-f024-4852-8395-20ce12413b7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.085659] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ac54556-f024-4852-8395-20ce12413b7e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.139908] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.140281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.140434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.140817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.141477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.141477] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.141477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.141477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.141941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.141941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.141941] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 712.170931] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.171193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.171341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.171674] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.171915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.181885] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 712.287813] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.288225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.288225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.288388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.288498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.288722] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.289384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.289535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.289747] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.289861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.289966] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce is going to be updated. [ 712.319141] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.320221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.320221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.320221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.320221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.327576] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce in Status: IN_PROGRESS for 2s [ 712.333217] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 712.333557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.462377] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9495602c-f01c-4935-941b-dacd2d1ea667: rpc.has_security_group_logging(os_id): False [ 712.480333] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.480333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.480333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.480654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.480710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.480987] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.481222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.481222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.481346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.481399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.481461] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9495602c-f01c-4935-941b-dacd2d1ea667 is going to be created. [ 712.539708] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.539878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.539915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.540734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.540734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.549960] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9495602c-f01c-4935-941b-dacd2d1ea667 in Status: IN_PROGRESS for 2s [ 712.589459] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.591376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.591376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.591376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.591376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.591376] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 5ac54556-f024-4852-8395-20ce12413b7e not found, creating... [ 712.591376] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.591703] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.591905] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.592532] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.592761] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.593842] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.593842] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.594316] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.594598] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.594809] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.595152] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 5ac54556-f024-4852-8395-20ce12413b7e is going to be created. [ 712.618878] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.618878] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.619061] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.621323] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.621704] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.622049] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-5ac54556-f024-4852-8395-20ce12413b7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.516587] env[69358]: INFO networking_nsxv3.common.synchronization [req-c742d610-a0ae-4761-afe2-d90d4bae1fb8 req-75e49a65-8768-4fe5-970b-500f828826b5 service nova] Enqueued Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGHEST for action security_group_rules [ 713.518020] env[69358]: INFO networking_nsxv3.common.synchronization [req-c742d610-a0ae-4761-afe2-d90d4bae1fb8 req-75e49a65-8768-4fe5-970b-500f828826b5 service nova] Enqueued Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGHEST for action security_group_members [ 713.518020] env[69358]: INFO networking_nsxv3.common.synchronization [req-c742d610-a0ae-4761-afe2-d90d4bae1fb8 req-75e49a65-8768-4fe5-970b-500f828826b5 service nova] Enqueued Resource ID: 5ac54556-f024-4852-8395-20ce12413b7e with Priority: HIGHEST for action port [ 713.518020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGHEST for action security_group_rules [ 713.518020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGHEST for action security_group_members [ 713.518020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ac54556-f024-4852-8395-20ce12413b7e with Priority: HIGHEST for action port [ 713.518217] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8ab349f-7df0-40a9-a595-1a8e298f956a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.518217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.518318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.518532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.518620] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.520706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ab349f-7df0-40a9-a595-1a8e298f956a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.520706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.520706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.520706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.520706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.520706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.520942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.520942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.521179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.521179] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.523945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ac54556-f024-4852-8395-20ce12413b7e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.523945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ac54556-f024-4852-8395-20ce12413b7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.523945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ac54556-f024-4852-8395-20ce12413b7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.523945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ac54556-f024-4852-8395-20ce12413b7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.523945] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ac54556-f024-4852-8395-20ce12413b7e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.020875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ab349f-7df0-40a9-a595-1a8e298f956a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.021066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.022758] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.026160] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ac54556-f024-4852-8395-20ce12413b7e with status ACTIVE [ 714.026388] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.027073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.027073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.027073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.027073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.027338] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.027338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.027338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.027466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.027512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.027696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.027842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.027842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.028028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.028199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.028309] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ac54556-f024-4852-8395-20ce12413b7e is going to be updated. [ 714.055202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.055389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.055456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.055625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.055755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.055920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ac54556-f024-4852-8395-20ce12413b7e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.192864] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 714.193093] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 deletion is rescheduled due to dependency. [ 714.193212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.339791] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce in Status: SUCCESS [ 714.339791] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce deletion is rescheduled due to dependency. [ 714.339900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.525443] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.563085] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9495602c-f01c-4935-941b-dacd2d1ea667 in Status: SUCCESS [ 714.563763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.033560] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.033883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.033883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.034053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.034129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.034220] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ab349f-7df0-40a9-a595-1a8e298f956a is going to be created. [ 715.054641] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.054792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.054867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.055119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.055288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.065021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ab349f-7df0-40a9-a595-1a8e298f956a in Status: UNINITIALIZED for 2s [ 715.131237] env[69358]: INFO networking_nsxv3.common.synchronization [None req-093ff8af-0c0f-4842-9d71-8fc679a56db9 None None] Enqueued Resource ID: 367a7bae-1f99-4821-8d75-4184b2136cdb with Priority: HIGHEST for action port [ 715.131494] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367a7bae-1f99-4821-8d75-4184b2136cdb with Priority: HIGHEST for action port [ 715.132491] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-367a7bae-1f99-4821-8d75-4184b2136cdb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.132491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-367a7bae-1f99-4821-8d75-4184b2136cdb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.132491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-367a7bae-1f99-4821-8d75-4184b2136cdb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.132664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-367a7bae-1f99-4821-8d75-4184b2136cdb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.132664] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367a7bae-1f99-4821-8d75-4184b2136cdb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.636323] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 367a7bae-1f99-4821-8d75-4184b2136cdb [ 715.636745] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.636745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.636922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.637298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.637298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.637298] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:367a7bae-1f99-4821-8d75-4184b2136cdb already deleted. [ 715.637409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-367a7bae-1f99-4821-8d75-4184b2136cdb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.806313] env[69358]: INFO networking_nsxv3.common.synchronization [req-00ea0107-308c-4935-ac7b-47b62b447d05 req-9038fa8e-7b67-40c9-ac10-cf9a148ce172 tempest-ServerMetadataTestJSON-1342094692 tempest-ServerMetadataTestJSON-1342094692-project-member] Enqueued Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGHEST for action security_group_members [ 715.806313] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGHEST for action security_group_members [ 715.806866] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-399e5b2f-147f-4c05-b525-1c92b4bd694d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.806866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.806866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.806866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.807104] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.807836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.808488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.810031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.810561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.810561] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.921474] env[69358]: INFO networking_nsxv3.common.synchronization [req-8b477b3c-8cc9-4d1a-92e3-baa265b37d70 req-d59bcaeb-ffb5-4c53-9ae8-5d1a4b96ae87 tempest-ListServerFiltersTestJSON-1173311410 tempest-ListServerFiltersTestJSON-1173311410-project-member] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 715.922042] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 715.922355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.922486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.922556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.922760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.922948] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.923070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.923070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.923277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.923334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.923394] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.318311] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.318311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.318311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.318916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.320059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.320059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.320059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.320059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.320434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.320642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.320885] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d is going to be updated. [ 716.348866] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.349161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.349263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.349602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.349752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.361990] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d in Status: IN_PROGRESS for 2s [ 716.425680] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.927997] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.075602] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ab349f-7df0-40a9-a595-1a8e298f956a in Status: SUCCESS [ 717.075929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.076409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.076616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.079460] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.079460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.079460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.079460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.079460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.079460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.079460] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.162984] env[69358]: INFO networking_nsxv3.common.synchronization [req-c389fb91-9654-4799-b691-29b2d67795e1 req-e5994501-1cd0-4419-af06-0d7f180de2d5 tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 717.166460] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 717.167375] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.167525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.167593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.167773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.167922] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.168369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.168369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.168369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.168369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.168771] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.244044] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.244044] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.244044] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.244044] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.244044] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.244044] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.244044] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.244044] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.244044] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.244044] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.244044] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.244977] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.245303] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.245576] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.245816] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.247646] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.266021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.266021] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.266021] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.266021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.266021] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a9615c92-0414-4cf5-8c84-955164299553 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.266021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a9615c92-0414-4cf5-8c84-955164299553" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.266021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a9615c92-0414-4cf5-8c84-955164299553" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.266021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a9615c92-0414-4cf5-8c84-955164299553" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.266021] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9615c92-0414-4cf5-8c84-955164299553',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.430114] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.430348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.430461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.430759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.430866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.431030] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 717.458498] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.463032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.463032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.463032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.463032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.470651] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 717.580919] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ab349f-7df0-40a9-a595-1a8e298f956a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.581090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.581291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.581580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.581793] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.581922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.582109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.582177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.582264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.582554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.582719] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ab349f-7df0-40a9-a595-1a8e298f956a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.582838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.582905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.583032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.583179] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.583278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.583346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.583489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.583565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.583649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.583757] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.681024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.681024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.681024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.681024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.681024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.681024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.681024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.681024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.681024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.681024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.681024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 717.707348] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.707348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.707348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.707348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.707348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.714067] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 717.772349] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.772349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.772349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.772349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.772349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.772349] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a9615c92-0414-4cf5-8c84-955164299553 not found, creating... [ 717.772349] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.772349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.772349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.772349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.772349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.772855] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.772855] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.772855] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.772855] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.773362] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.774317] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a9615c92-0414-4cf5-8c84-955164299553 is going to be created. [ 717.795952] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.796988] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.796988] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.797711] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.797977] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.798897] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a9615c92-0414-4cf5-8c84-955164299553" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.088288] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8ab349f-7df0-40a9-a595-1a8e298f956a: rpc.has_security_group_logging(os_id): False [ 718.108135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.108135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.108135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.108135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.108753] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.108753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.108753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.108753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.108753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.108753] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8ab349f-7df0-40a9-a595-1a8e298f956a is going to be created. [ 718.131417] env[69358]: INFO networking_nsxv3.common.synchronization [None req-2c9bc566-6c35-4e59-86c0-bc87c7d3e76d None None] Enqueued Resource ID: ea7dcbd5-915d-4545-a6dd-3efb638c572b with Priority: HIGHEST for action port [ 718.131417] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea7dcbd5-915d-4545-a6dd-3efb638c572b with Priority: HIGHEST for action port [ 718.131417] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea7dcbd5-915d-4545-a6dd-3efb638c572b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.131417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea7dcbd5-915d-4545-a6dd-3efb638c572b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.131417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea7dcbd5-915d-4545-a6dd-3efb638c572b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.131417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea7dcbd5-915d-4545-a6dd-3efb638c572b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.131741] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea7dcbd5-915d-4545-a6dd-3efb638c572b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.166258] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.168869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.168869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.168869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.168869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.181602] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8ab349f-7df0-40a9-a595-1a8e298f956a in Status: IN_PROGRESS for 2s [ 718.371935] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d in Status: SUCCESS [ 718.372132] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d deletion is rescheduled due to dependency. [ 718.372271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.496672] env[69358]: INFO networking_nsxv3.common.synchronization [req-325c43ee-4859-4c12-bc23-14380e47a630 req-c0caf85c-7aa5-4c45-997b-dd90bd91fe6a tempest-ServerAddressesNegativeTestJSON-1152118785 tempest-ServerAddressesNegativeTestJSON-1152118785-project-member] Enqueued Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGHEST for action security_group_members [ 718.497064] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGHEST for action security_group_members [ 718.497064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.497247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.497247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.497566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.501353] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.501937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.502045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.502716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.502716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.502855] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.585117] env[69358]: INFO networking_nsxv3.common.synchronization [None req-d641cebb-b56b-4d5a-92f4-3773f7b0e782 None None] Enqueued Resource ID: 155078f3-0638-40ab-95a6-16d27daeae54 with Priority: HIGHEST for action port [ 718.585899] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155078f3-0638-40ab-95a6-16d27daeae54 with Priority: HIGHEST for action port [ 718.586376] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-155078f3-0638-40ab-95a6-16d27daeae54 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.586625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-155078f3-0638-40ab-95a6-16d27daeae54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.586686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-155078f3-0638-40ab-95a6-16d27daeae54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.587025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-155078f3-0638-40ab-95a6-16d27daeae54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.587025] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('155078f3-0638-40ab-95a6-16d27daeae54',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.634946] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea7dcbd5-915d-4545-a6dd-3efb638c572b [ 718.634946] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.634946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.634946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.635309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.635309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.635435] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea7dcbd5-915d-4545-a6dd-3efb638c572b already deleted. [ 718.635530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea7dcbd5-915d-4545-a6dd-3efb638c572b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.011333] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.011333] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.011333] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 already deleted. [ 719.011333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.016974] env[69358]: INFO networking_nsxv3.common.synchronization [req-8b477b3c-8cc9-4d1a-92e3-baa265b37d70 req-077ede1e-4e26-48ea-ad1f-7ab07ebe05e1 service nova] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_rules [ 719.016974] env[69358]: INFO networking_nsxv3.common.synchronization [req-8b477b3c-8cc9-4d1a-92e3-baa265b37d70 req-077ede1e-4e26-48ea-ad1f-7ab07ebe05e1 service nova] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 719.016974] env[69358]: INFO networking_nsxv3.common.synchronization [req-8b477b3c-8cc9-4d1a-92e3-baa265b37d70 req-077ede1e-4e26-48ea-ad1f-7ab07ebe05e1 service nova] Enqueued Resource ID: a9615c92-0414-4cf5-8c84-955164299553 with Priority: HIGHEST for action port [ 719.016974] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_rules [ 719.016974] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 719.017842] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9615c92-0414-4cf5-8c84-955164299553 with Priority: HIGHEST for action port [ 719.018299] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.018877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.022634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.022634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.022634] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.024100] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.024100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.024100] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9615c92-0414-4cf5-8c84-955164299553 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.024100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9615c92-0414-4cf5-8c84-955164299553" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.024100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9615c92-0414-4cf5-8c84-955164299553" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.024100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9615c92-0414-4cf5-8c84-955164299553" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.024437] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9615c92-0414-4cf5-8c84-955164299553',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.090191] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 155078f3-0638-40ab-95a6-16d27daeae54 [ 719.090504] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.090695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.090695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.091301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.091301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.091301] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:155078f3-0638-40ab-95a6-16d27daeae54 already deleted. [ 719.091301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-155078f3-0638-40ab-95a6-16d27daeae54" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.308937] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.308937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-510" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.308937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-510" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.308937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-510" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.308937] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.308937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.308937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.310542] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.310735] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.310923] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.311053] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.311152] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.311286] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.311417] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.311550] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.311848] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.332116] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.332730] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.332730] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.332730] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-510" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.333184] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4e4bead7-2f69-40cb-8475-85bc211d0b60 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.333428] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4e4bead7-2f69-40cb-8475-85bc211d0b60" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.333428] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4e4bead7-2f69-40cb-8475-85bc211d0b60" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.334123] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4e4bead7-2f69-40cb-8475-85bc211d0b60" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.334123] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4bead7-2f69-40cb-8475-85bc211d0b60',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.480741] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 719.480741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.480741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.480741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.480741] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.480741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.480741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.480741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.480741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.480741] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.537031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.537031] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9615c92-0414-4cf5-8c84-955164299553 with status ACTIVE [ 719.537031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.537031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.537031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.537031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.537640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.537640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.537640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.538059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.538217] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9615c92-0414-4cf5-8c84-955164299553 is going to be updated. [ 719.557909] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.558109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.558195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.558414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.558547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.558708] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9615c92-0414-4cf5-8c84-955164299553" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.728514] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 719.728514] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 deletion is rescheduled due to dependency. [ 719.728514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.839789] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.839789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.839789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.839789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.839789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.839789] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 4e4bead7-2f69-40cb-8475-85bc211d0b60 not found, creating... [ 719.839789] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.839789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.839789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.839789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.840402] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.840786] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.841074] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.841277] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.842039] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.842371] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.842578] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4e4bead7-2f69-40cb-8475-85bc211d0b60 is going to be created. [ 719.862235] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.862443] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.862566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.862844] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.863108] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.863343] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4e4bead7-2f69-40cb-8475-85bc211d0b60" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.983401] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.196036] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8ab349f-7df0-40a9-a595-1a8e298f956a in Status: SUCCESS [ 720.196376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.488475] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.991745] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.991745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.991745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.991745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.991745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.992109] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 721.024451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.024451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.024451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.024451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.024451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.035616] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 721.051035] env[69358]: INFO networking_nsxv3.common.synchronization [req-325c43ee-4859-4c12-bc23-14380e47a630 req-600d0d2e-2975-49c6-a81f-14fd1359d666 service nova] Enqueued Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGHEST for action security_group_rules [ 721.051035] env[69358]: INFO networking_nsxv3.common.synchronization [req-325c43ee-4859-4c12-bc23-14380e47a630 req-600d0d2e-2975-49c6-a81f-14fd1359d666 service nova] Enqueued Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGHEST for action security_group_members [ 721.051035] env[69358]: INFO networking_nsxv3.common.synchronization [req-325c43ee-4859-4c12-bc23-14380e47a630 req-600d0d2e-2975-49c6-a81f-14fd1359d666 service nova] Enqueued Resource ID: 4e4bead7-2f69-40cb-8475-85bc211d0b60 with Priority: HIGHEST for action port [ 721.051035] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGHEST for action security_group_rules [ 721.051273] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGHEST for action security_group_members [ 721.051273] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e4bead7-2f69-40cb-8475-85bc211d0b60 with Priority: HIGHEST for action port [ 721.051800] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.051924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.051990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.052277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.052322] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.053153] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.053276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.053345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.053514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.053660] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.053759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.053823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.053959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.058783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.058783] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.058783] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e4bead7-2f69-40cb-8475-85bc211d0b60 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.058783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e4bead7-2f69-40cb-8475-85bc211d0b60" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.058783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e4bead7-2f69-40cb-8475-85bc211d0b60" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.059290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e4bead7-2f69-40cb-8475-85bc211d0b60" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.059290] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4bead7-2f69-40cb-8475-85bc211d0b60',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.077662] env[69358]: INFO networking_nsxv3.common.synchronization [req-593a76a7-5feb-42e0-9a6f-e38eede567cf req-9e543c4e-4717-4b70-a69f-ed471d9dc310 tempest-FloatingIPsAssociationNegativeTestJSON-939904867 tempest-FloatingIPsAssociationNegativeTestJSON-939904867-project-member] Enqueued Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGHEST for action security_group_members [ 721.079462] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGHEST for action security_group_members [ 721.079788] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2fd29d-e8c3-4394-a485-44391d15526c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.079917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.079982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.080293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.080462] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.080572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.080634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.080785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.080868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.080959] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.130882] env[69358]: INFO networking_nsxv3.common.synchronization [None req-71ed8d63-e4a0-44d5-bc03-48b96fbcdc1a None None] Enqueued Resource ID: acad6516-10ab-49f4-a6ef-835ab5fc2e59 with Priority: HIGHEST for action port [ 721.131560] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acad6516-10ab-49f4-a6ef-835ab5fc2e59 with Priority: HIGHEST for action port [ 721.131978] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-acad6516-10ab-49f4-a6ef-835ab5fc2e59 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.135313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acad6516-10ab-49f4-a6ef-835ab5fc2e59" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.135396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acad6516-10ab-49f4-a6ef-835ab5fc2e59" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.135633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acad6516-10ab-49f4-a6ef-835ab5fc2e59" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.135717] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acad6516-10ab-49f4-a6ef-835ab5fc2e59',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.560809] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.562560] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.562560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.562821] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e4bead7-2f69-40cb-8475-85bc211d0b60 with status ACTIVE [ 721.562944] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.563102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.563175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.563333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.563415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.563651] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.563764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.564122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.564122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.564122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.564401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.564401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.564790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.564848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.564905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.565110] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e4bead7-2f69-40cb-8475-85bc211d0b60 is going to be updated. [ 721.586289] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.586457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.586560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.586746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.586830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.587035] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.587198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.587198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.587351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.587449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.587503] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2fd29d-e8c3-4394-a485-44391d15526c already deleted. [ 721.587577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.588611] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.588725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.588780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.588931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.590314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.590532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e4bead7-2f69-40cb-8475-85bc211d0b60" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.638621] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acad6516-10ab-49f4-a6ef-835ab5fc2e59 [ 721.638741] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.638842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.638910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.639106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.639192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.639289] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acad6516-10ab-49f4-a6ef-835ab5fc2e59 already deleted. [ 721.639359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acad6516-10ab-49f4-a6ef-835ab5fc2e59" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.721555] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.721795] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-16" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.725097] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-16" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.725097] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-16" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.725097] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.725097] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.725097] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.725097] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.725097] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.725097] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.725097] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.725097] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.725097] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.725097] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.725097] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.725097] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.745486] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.745486] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 721.745486] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.745486] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-16" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.745783] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.745870] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.746527] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.747761] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.747761] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44d3284b-f19c-4b8b-83e2-85e49b7c6d29',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.831267] env[69358]: INFO networking_nsxv3.common.synchronization [None req-eed494d3-a32d-4359-a4f7-9bd62e2fff1d None None] Enqueued Resource ID: a4c9fc37-65a8-45c6-90e4-4a2130f89511 with Priority: HIGHEST for action port [ 721.831859] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c9fc37-65a8-45c6-90e4-4a2130f89511 with Priority: HIGHEST for action port [ 721.832184] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4c9fc37-65a8-45c6-90e4-4a2130f89511 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.832318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4c9fc37-65a8-45c6-90e4-4a2130f89511" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.832387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4c9fc37-65a8-45c6-90e4-4a2130f89511" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.832633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4c9fc37-65a8-45c6-90e4-4a2130f89511" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.832717] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4c9fc37-65a8-45c6-90e4-4a2130f89511',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.068212] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.250890] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.251204] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.251260] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.251591] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.253094] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.253094] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 44d3284b-f19c-4b8b-83e2-85e49b7c6d29 not found, creating... [ 722.253936] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.254127] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.254256] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.254518] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.254710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.255050] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.257480] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.257643] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.257928] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.258086] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.258236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 44d3284b-f19c-4b8b-83e2-85e49b7c6d29 is going to be created. [ 722.278457] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.278665] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.278793] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.279102] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.279337] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.279559] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.337207] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4c9fc37-65a8-45c6-90e4-4a2130f89511 [ 722.337455] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.337604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.337676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.337911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.338037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.338139] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4c9fc37-65a8-45c6-90e4-4a2130f89511 already deleted. [ 722.338227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4c9fc37-65a8-45c6-90e4-4a2130f89511" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.570424] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.574107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.574107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.574107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.574107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.574107] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 is going to be created. [ 722.597331] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.597331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.597331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.597331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.597331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.606307] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 in Status: UNINITIALIZED for 2s [ 723.048162] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 723.048162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.048162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.048162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.048162] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.048162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.048162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.048162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.048162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.048162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.048162] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.379068] env[69358]: INFO networking_nsxv3.common.synchronization [req-593a76a7-5feb-42e0-9a6f-e38eede567cf req-f682b862-6bbb-4d12-a144-b9d0b596333d service nova] Enqueued Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGHEST for action security_group_rules [ 723.379554] env[69358]: INFO networking_nsxv3.common.synchronization [req-593a76a7-5feb-42e0-9a6f-e38eede567cf req-f682b862-6bbb-4d12-a144-b9d0b596333d service nova] Enqueued Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGHEST for action security_group_members [ 723.379554] env[69358]: INFO networking_nsxv3.common.synchronization [req-593a76a7-5feb-42e0-9a6f-e38eede567cf req-f682b862-6bbb-4d12-a144-b9d0b596333d service nova] Enqueued Resource ID: 44d3284b-f19c-4b8b-83e2-85e49b7c6d29 with Priority: HIGHEST for action port [ 723.385607] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGHEST for action security_group_rules [ 723.385838] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGHEST for action security_group_members [ 723.386279] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44d3284b-f19c-4b8b-83e2-85e49b7c6d29 with Priority: HIGHEST for action port [ 723.386736] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2fd29d-e8c3-4394-a485-44391d15526c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.386936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.388752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.388752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.388752] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.389397] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2fd29d-e8c3-4394-a485-44391d15526c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.389397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.389534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.389640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.390464] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.390464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.390464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.390464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.390464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.390464] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.393739] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.393739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.393739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.393739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.393739] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44d3284b-f19c-4b8b-83e2-85e49b7c6d29',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.433636] env[69358]: INFO networking_nsxv3.common.synchronization [req-d32f3120-916d-487f-946d-90bbdc3be210 req-77472b4f-e5ae-4b37-94d5-07c629e8c8ba tempest-ServersTestJSON-737576159 tempest-ServersTestJSON-737576159-project-member] Enqueued Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_members [ 723.436739] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGHEST for action security_group_members [ 723.437543] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-908f61ef-0a88-4419-a8be-58a9e18a05ea taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.437674] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.437743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.437941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.438358] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.438524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.438598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.438772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.438865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.438967] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.557900] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.558982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.558982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.558982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.559588] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.559770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.559894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.560197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.560598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.560598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.560841] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.560992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.561866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.562432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.562432] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.562734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.562734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.562879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.563020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.563238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.563316] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.893714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2fd29d-e8c3-4394-a485-44391d15526c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.895165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.895165] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44d3284b-f19c-4b8b-83e2-85e49b7c6d29 with status ACTIVE [ 723.895165] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.895165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.895165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.895384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.895420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.895703] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.895826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.895889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.896066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.896148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.896333] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.896433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.896497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.896729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.896729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.896864] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44d3284b-f19c-4b8b-83e2-85e49b7c6d29 is going to be updated. [ 723.898605] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.921886] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.921886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.921886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.921886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.921886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.921886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44d3284b-f19c-4b8b-83e2-85e49b7c6d29" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.940696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.940885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.940929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.941163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.941256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.941453] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.941554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.941609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.941767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.941836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.941923] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea is going to be updated. [ 723.976461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.976888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.976888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.977097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.977231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.990276] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea in Status: IN_PROGRESS for 2s [ 724.066321] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd2c3b18-33a0-460a-a199-3124440c68e8: rpc.has_security_group_logging(os_id): False [ 724.085994] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.086702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.086774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.087035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.087162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.087670] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.087936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.088123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.088346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.088439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.088663] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.088760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.088821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.088971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.089127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.089381] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.089508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.090179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.090179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.090179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.090179] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 724.154191] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.154191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.154191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.154191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.154191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.165814] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 724.183185] env[69358]: INFO networking_nsxv3.common.synchronization [None req-36a363db-67b8-4c5b-8439-e56a6fe58d89 None None] Enqueued Resource ID: 2376730b-cb94-4020-8990-8b6df7759df8 with Priority: HIGHEST for action port [ 724.183185] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2376730b-cb94-4020-8990-8b6df7759df8 with Priority: HIGHEST for action port [ 724.183185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-2376730b-cb94-4020-8990-8b6df7759df8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.183569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2376730b-cb94-4020-8990-8b6df7759df8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.183569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2376730b-cb94-4020-8990-8b6df7759df8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.183641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2376730b-cb94-4020-8990-8b6df7759df8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.183680] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2376730b-cb94-4020-8990-8b6df7759df8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.400705] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.614621] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 in Status: SUCCESS [ 724.614621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.614621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.614621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.614621] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.614621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.614621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.614621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.614621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.614621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.615287] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.689021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2376730b-cb94-4020-8990-8b6df7759df8 [ 724.689270] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.689551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.689551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.689772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.692506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.692506] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2376730b-cb94-4020-8990-8b6df7759df8 already deleted. [ 724.692506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2376730b-cb94-4020-8990-8b6df7759df8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.905139] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.905139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.905139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.905139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.905516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.905516] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2fd29d-e8c3-4394-a485-44391d15526c is going to be created. [ 724.928483] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.928664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.928740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.929031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.929110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.939299] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2fd29d-e8c3-4394-a485-44391d15526c in Status: UNINITIALIZED for 2s [ 725.123483] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.123666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.123763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.123969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.124163] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.124266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.124320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.124471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.124560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.124649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.124796] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.124893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.124950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.125110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.125252] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.125353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.125407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.125578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.125643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.125704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.125763] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.628162] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46002bc2-9685-44d1-a0f5-f9a4ebc7e375: rpc.has_security_group_logging(os_id): False [ 725.646484] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.647444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.647444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.647444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.647444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.647444] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.647444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.647444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.647957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.647957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.647957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.647957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.647957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.648150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.648150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.648318] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.648409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.648466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.648613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.648697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.648771] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 is going to be created. [ 725.716053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.716053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.716053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.716053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.716053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.725245] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 in Status: IN_PROGRESS for 2s [ 725.999773] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea in Status: SUCCESS [ 726.000052] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea deletion is rescheduled due to dependency. [ 726.000052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.178853] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 726.179081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.948631] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2fd29d-e8c3-4394-a485-44391d15526c in Status: SUCCESS [ 726.948933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.949015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.949247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.949440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.949563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.949629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.950634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.950769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.950868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.950975] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.020055] env[69358]: INFO networking_nsxv3.common.synchronization [req-1735cb44-2069-4eeb-b924-dc5312955b7d req-bdb79f3b-c50d-49cf-9c0b-8a6398722930 tempest-ListServerFiltersTestJSON-1173311410 tempest-ListServerFiltersTestJSON-1173311410-project-member] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 727.020055] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 727.020055] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.020055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.020055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.020055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.020055] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.020055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.021209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.021497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.021900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.022124] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.454558] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2fd29d-e8c3-4394-a485-44391d15526c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.454745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.454821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.455054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.455235] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.455335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.455403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.455555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.455643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.455729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.455875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2fd29d-e8c3-4394-a485-44391d15526c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.455970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.456042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.456184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.456318] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.456411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.456471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.456631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.456720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.456811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.456914] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.458459] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.458670] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.458813] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.459074] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.459342] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.460435] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.460601] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.460838] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.460981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.461222] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.461356] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.461499] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.461619] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.461736] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.461858] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.461974] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.479861] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.480039] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 727.480185] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.480361] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-166" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.481123] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e9b012c4-f821-4813-b3c8-c3b7f962ba85 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.481123] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e9b012c4-f821-4813-b3c8-c3b7f962ba85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.481123] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e9b012c4-f821-4813-b3c8-c3b7f962ba85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.481907] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e9b012c4-f821-4813-b3c8-c3b7f962ba85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.482145] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9b012c4-f821-4813-b3c8-c3b7f962ba85',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.525976] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.746345] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 in Status: SUCCESS [ 727.746345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.964014] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad2fd29d-e8c3-4394-a485-44391d15526c: rpc.has_security_group_logging(os_id): False [ 727.982138] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.982138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.982138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.982384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.982384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.983029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.983029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.983029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.983029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.983029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.983029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.983425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.983425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.983425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.983425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.983577] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.983670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.983731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.983868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.984115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.984236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2fd29d-e8c3-4394-a485-44391d15526c is going to be created. [ 727.986082] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.986281] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.986404] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.986729] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.986882] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.987037] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e9b012c4-f821-4813-b3c8-c3b7f962ba85 not found, creating... [ 727.987288] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.987490] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.987551] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.987892] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.988043] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.988683] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.989070] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.989070] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.989583] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.989583] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.989685] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e9b012c4-f821-4813-b3c8-c3b7f962ba85 is going to be created. [ 728.009545] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.009763] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.009989] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.010185] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.010465] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.010699] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e9b012c4-f821-4813-b3c8-c3b7f962ba85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.028326] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.059971] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.060162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.060227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.060440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.060612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.071863] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad2fd29d-e8c3-4394-a485-44391d15526c in Status: IN_PROGRESS for 2s [ 728.530559] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.530745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.530844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.531100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.531209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.531337] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 728.558099] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.558380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.558380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.558526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.558669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.568968] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 728.862160] env[69358]: INFO networking_nsxv3.common.synchronization [req-1735cb44-2069-4eeb-b924-dc5312955b7d req-dbb619a4-81a4-4b45-85a6-f70157120478 service nova] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_rules [ 728.862160] env[69358]: INFO networking_nsxv3.common.synchronization [req-1735cb44-2069-4eeb-b924-dc5312955b7d req-dbb619a4-81a4-4b45-85a6-f70157120478 service nova] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 728.862160] env[69358]: INFO networking_nsxv3.common.synchronization [req-1735cb44-2069-4eeb-b924-dc5312955b7d req-dbb619a4-81a4-4b45-85a6-f70157120478 service nova] Enqueued Resource ID: e9b012c4-f821-4813-b3c8-c3b7f962ba85 with Priority: HIGHEST for action port [ 728.862160] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_rules [ 728.862160] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 728.862160] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9b012c4-f821-4813-b3c8-c3b7f962ba85 with Priority: HIGHEST for action port [ 728.863064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.863365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.863770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.864221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.865095] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.866321] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.866583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.866915] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9b012c4-f821-4813-b3c8-c3b7f962ba85 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.868018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9b012c4-f821-4813-b3c8-c3b7f962ba85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.868018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9b012c4-f821-4813-b3c8-c3b7f962ba85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.868018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9b012c4-f821-4813-b3c8-c3b7f962ba85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.868018] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9b012c4-f821-4813-b3c8-c3b7f962ba85',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.252185] env[69358]: INFO networking_nsxv3.common.synchronization [req-fb0056a4-5bcf-494f-bce3-78d06421d4b3 req-02029c76-ccc2-4e28-93fa-0f785703a0d0 tempest-InstanceActionsNegativeTestJSON-1309089097 tempest-InstanceActionsNegativeTestJSON-1309089097-project-member] Enqueued Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGHEST for action security_group_members [ 729.253253] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGHEST for action security_group_members [ 729.253253] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ab349f-7df0-40a9-a595-1a8e298f956a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.253253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.253474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.255023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.255023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.255023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.255023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.255023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.255023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.255023] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.367119] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.367392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.370098] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9b012c4-f821-4813-b3c8-c3b7f962ba85 with status ACTIVE [ 729.370707] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.370707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.370886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.370963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.371045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.371202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.371300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.371359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.371509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.371597] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.371777] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.371873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.371935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.372094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.372172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.372258] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9b012c4-f821-4813-b3c8-c3b7f962ba85 is going to be updated. [ 729.396078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.396078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.396078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.396078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.396078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.396078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9b012c4-f821-4813-b3c8-c3b7f962ba85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.720366] env[69358]: INFO networking_nsxv3.common.synchronization [req-a4b8b0e6-a06b-4407-b289-017681ca68a7 req-439ff444-a623-4b98-9b0a-ca4f9e55b9da tempest-FloatingIPsAssociationTestJSON-1066125890 tempest-FloatingIPsAssociationTestJSON-1066125890-project-member] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 729.720969] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 729.721559] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.721559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.721559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.721814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.722579] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.722579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.722579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.722579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.722809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.722809] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.756095] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.756258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.756327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.756545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.756937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.756937] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.756937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.757131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.757131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.757203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.757302] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ab349f-7df0-40a9-a595-1a8e298f956a is going to be updated. [ 729.787642] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.787824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.787896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.788138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.788293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.795871] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ab349f-7df0-40a9-a595-1a8e298f956a in Status: IN_PROGRESS for 2s [ 730.085758] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad2fd29d-e8c3-4394-a485-44391d15526c in Status: SUCCESS [ 730.085758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.224755] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.224937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.225021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.225241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.225351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.225565] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.225669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.225733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.225885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.225963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.226059] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e4e649-079d-4cd0-98f4-699005461275 already deleted. [ 730.226162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.414819] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-241 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.415137] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-241" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.416452] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-241" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.416790] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-241" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.417193] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.417288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.417409] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.417634] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.417793] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.417977] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.418105] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.418215] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.418321] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.418429] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.418533] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.418779] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.441309] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.441484] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 730.441633] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.441814] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-241" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.442147] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-5e6c01c8-8a99-4361-828f-f40c2d3ececd taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.442327] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-5e6c01c8-8a99-4361-828f-f40c2d3ececd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.442447] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-5e6c01c8-8a99-4361-828f-f40c2d3ececd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.442787] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-5e6c01c8-8a99-4361-828f-f40c2d3ececd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.442936] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e6c01c8-8a99-4361-828f-f40c2d3ececd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.577773] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 730.578069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.578221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.578429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.578612] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.578742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.578844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.578950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.579030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.579130] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.951025] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.951025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.951025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.951025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.951025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.951025] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 5e6c01c8-8a99-4361-828f-f40c2d3ececd not found, creating... [ 730.951025] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.951025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.951025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.952302] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.952601] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.953467] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.953781] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.954187] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.954686] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.956756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.956756] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 5e6c01c8-8a99-4361-828f-f40c2d3ececd is going to be created. [ 730.976294] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.976294] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.976294] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.976294] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.976294] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.977129] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-5e6c01c8-8a99-4361-828f-f40c2d3ececd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.083673] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.586779] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.804900] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ab349f-7df0-40a9-a595-1a8e298f956a in Status: SUCCESS [ 731.805124] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ab349f-7df0-40a9-a595-1a8e298f956a deletion is rescheduled due to dependency. [ 731.805241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.969499] env[69358]: INFO networking_nsxv3.common.synchronization [req-a4b8b0e6-a06b-4407-b289-017681ca68a7 req-4a566e2d-779d-4765-869a-7a7ef572d84c service nova] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_rules [ 731.974921] env[69358]: INFO networking_nsxv3.common.synchronization [req-a4b8b0e6-a06b-4407-b289-017681ca68a7 req-4a566e2d-779d-4765-869a-7a7ef572d84c service nova] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 731.974921] env[69358]: INFO networking_nsxv3.common.synchronization [req-a4b8b0e6-a06b-4407-b289-017681ca68a7 req-4a566e2d-779d-4765-869a-7a7ef572d84c service nova] Enqueued Resource ID: 5e6c01c8-8a99-4361-828f-f40c2d3ececd with Priority: HIGHEST for action port [ 731.976479] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_rules [ 731.977121] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 731.977197] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e6c01c8-8a99-4361-828f-f40c2d3ececd with Priority: HIGHEST for action port [ 731.978160] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.978160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.978160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.978160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.978160] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.980183] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.980305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.980426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.980609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.980769] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.980871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.980947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.981150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.981238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.981332] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.983253] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e6c01c8-8a99-4361-828f-f40c2d3ececd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.983636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e6c01c8-8a99-4361-828f-f40c2d3ececd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.983636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e6c01c8-8a99-4361-828f-f40c2d3ececd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.983636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e6c01c8-8a99-4361-828f-f40c2d3ececd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.983636] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e6c01c8-8a99-4361-828f-f40c2d3ececd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.090023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.090191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.090268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.090548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.090657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.090757] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 732.117787] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.117787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.117787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.117787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.117787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.125265] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 732.486514] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.487578] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.487692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.487977] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e6c01c8-8a99-4361-828f-f40c2d3ececd with status ACTIVE [ 732.488177] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.488296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.488365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.488688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.488790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.488974] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.489058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.489118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.489266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.489403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.489515] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.489601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.489662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.489826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.490061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.490189] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e6c01c8-8a99-4361-828f-f40c2d3ececd is going to be updated. [ 732.510303] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.510303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.510479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.510584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.511106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.511106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e6c01c8-8a99-4361-828f-f40c2d3ececd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.992754] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.496017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.496017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.496017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.496017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.496017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.496367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e4e649-079d-4cd0-98f4-699005461275 is going to be created. [ 733.522218] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.522218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.522218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.522218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.522218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.529864] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: UNINITIALIZED for 2s [ 734.134346] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 4s [ 734.996887] env[69358]: INFO networking_nsxv3.common.synchronization [req-ccb77037-c4e7-4e78-9918-e43337c14700 req-2b063a07-4a63-4001-ac23-74a5d1a2e76e tempest-ServerAddressesNegativeTestJSON-1152118785 tempest-ServerAddressesNegativeTestJSON-1152118785-project-member] Enqueued Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGHEST for action security_group_members [ 734.997751] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGHEST for action security_group_members [ 734.998053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.998182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.998251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.999228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.999228] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.999228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.999228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.999228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.999228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.999228] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.501581] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.502892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.502892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.502892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.502892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.505684] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.505684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.505684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.505684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.505684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.505684] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 is going to be updated. [ 735.542565] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: SUCCESS [ 735.542565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.542565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.542565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.542565] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.542565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.542565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.542885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.543580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.543580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.543580] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.549025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.549156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.549228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.549435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.549537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.557996] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 in Status: IN_PROGRESS for 2s [ 736.046232] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.046401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.046477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.046823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.047082] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.047214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.047403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.047475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.047639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.047758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.047945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.048059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.048125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.048280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.048704] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.048704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.048704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.048848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.048913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.048999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.049103] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.142797] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 736.143059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.143228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.143472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.143691] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.143815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.143889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.144129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.144225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.144315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.144426] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.551627] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1e4e649-079d-4cd0-98f4-699005461275: rpc.has_security_group_logging(os_id): False [ 736.569440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.569440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.569440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.569440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.569720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.569720] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.569853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.569878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.570131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.570266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.570371] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.570473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.570536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.570747] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.570831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.571161] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.571257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.571257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.571582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.571582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.571668] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1e4e649-079d-4cd0-98f4-699005461275 is going to be created. [ 736.624146] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.624315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.624388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.624751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.624853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.634512] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: IN_PROGRESS for 2s [ 736.650199] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.650531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.650726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.651012] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.651209] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.651319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.651476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.651666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.651759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.651852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.652020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.652122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.652242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.652732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.652732] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.652732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.652732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.652926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.653008] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.653171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.653199] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.116980] env[69358]: INFO networking_nsxv3.common.synchronization [req-f71ed2f1-a070-4913-bd94-702424172adc req-f16c8cfa-c0f2-4fae-b1fe-bd4ef0c50ab3 tempest-ServersAdminTestJSON-846589263 tempest-ServersAdminTestJSON-846589263-project-member] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 737.116980] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 737.116980] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.116980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.116980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.116980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.119193] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.119411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.119542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.119766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.120028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.120227] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.160622] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd2c3b18-33a0-460a-a199-3124440c68e8: rpc.has_security_group_logging(os_id): False [ 737.178024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.178024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.178024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.178024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.178580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.178580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.178580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.178580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.178580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.178580] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 737.239021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.239021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.239021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.239021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.239021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.252465] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 737.570264] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 in Status: SUCCESS [ 737.570264] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 deletion is rescheduled due to dependency. [ 737.570264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.623763] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.904403] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.904652] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.905748] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.905748] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.905748] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.905748] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.905748] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.905989] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.905989] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.907137] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.907282] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.907399] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.907528] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.907653] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.907761] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.907908] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.925296] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.925563] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 737.925828] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.926463] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.926673] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-8769899b-5df9-435b-ac70-d85f7a885989 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.927014] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-8769899b-5df9-435b-ac70-d85f7a885989" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.927292] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-8769899b-5df9-435b-ac70-d85f7a885989" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.928908] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-8769899b-5df9-435b-ac70-d85f7a885989" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.928908] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8769899b-5df9-435b-ac70-d85f7a885989',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.130088] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.431372] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.431764] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.431973] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.438709] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.438965] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.439138] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 8769899b-5df9-435b-ac70-d85f7a885989 not found, creating... [ 738.439403] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.439578] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.439700] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.439948] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.440365] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.440702] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.440859] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.440980] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.441239] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.441371] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.441862] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 8769899b-5df9-435b-ac70-d85f7a885989 is going to be created. [ 738.460810] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.461047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.461183] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.461460] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.461741] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.462034] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-8769899b-5df9-435b-ac70-d85f7a885989" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.632132] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.632132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.632132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.632132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.632132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.632132] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 738.650685] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: SUCCESS [ 738.650685] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.671750] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.671908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.671979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.672221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.672365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.682380] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 739.266412] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 739.266641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.889970] env[69358]: INFO networking_nsxv3.common.synchronization [req-f71ed2f1-a070-4913-bd94-702424172adc req-ab83dab0-3283-4cd8-9441-c144587a023e service nova] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_rules [ 739.890236] env[69358]: INFO networking_nsxv3.common.synchronization [req-f71ed2f1-a070-4913-bd94-702424172adc req-ab83dab0-3283-4cd8-9441-c144587a023e service nova] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 739.890319] env[69358]: INFO networking_nsxv3.common.synchronization [req-f71ed2f1-a070-4913-bd94-702424172adc req-ab83dab0-3283-4cd8-9441-c144587a023e service nova] Enqueued Resource ID: 8769899b-5df9-435b-ac70-d85f7a885989 with Priority: HIGHEST for action port [ 739.890817] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_rules [ 739.890947] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 739.891048] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8769899b-5df9-435b-ac70-d85f7a885989 with Priority: HIGHEST for action port [ 739.891312] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.891437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.891505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.891699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.891799] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.894526] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.895020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.895020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-8769899b-5df9-435b-ac70-d85f7a885989 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.895020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8769899b-5df9-435b-ac70-d85f7a885989" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.895020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8769899b-5df9-435b-ac70-d85f7a885989" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.895218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8769899b-5df9-435b-ac70-d85f7a885989" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.895218] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8769899b-5df9-435b-ac70-d85f7a885989',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.068106] env[69358]: INFO networking_nsxv3.common.synchronization [req-6fa9b3e7-0868-48a5-9d01-a2a0389d56e3 req-86f54a2f-36b3-4e6c-be51-116e4aa807cc tempest-AttachInterfacesV270Test-1511023883 tempest-AttachInterfacesV270Test-1511023883-project-member] Enqueued Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGHEST for action security_group_members [ 740.068106] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGHEST for action security_group_members [ 740.068106] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.068106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.068106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.072285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.072285] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.072285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.072285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.072285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.072285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.072465] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.397868] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.398029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.398425] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8769899b-5df9-435b-ac70-d85f7a885989 with status ACTIVE [ 740.398425] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.398562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.398590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.398796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.398887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.399067] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.399160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.399226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.399378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.399458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.399637] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.399765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.399815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.399934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.399982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.400107] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8769899b-5df9-435b-ac70-d85f7a885989 is going to be updated. [ 740.428748] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.428748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.428748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.428748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.428748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.428748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8769899b-5df9-435b-ac70-d85f7a885989" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.576798] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.576975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.577049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.577273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.577372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.577580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.577686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.577749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.577904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.577982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.578087] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa already deleted. [ 740.578167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.624378] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.624594] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-860" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.624699] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-860" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.625030] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-860" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.625761] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.625761] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.625761] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.625959] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.626142] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.626348] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.626462] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.626570] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.626751] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.626798] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.626858] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.627027] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.644018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.644682] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.644682] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.644682] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-860" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.644794] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-c3be55e2-c17c-4035-8e41-2db86264ffc5 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.645503] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-c3be55e2-c17c-4035-8e41-2db86264ffc5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.647395] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-c3be55e2-c17c-4035-8e41-2db86264ffc5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.647724] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-c3be55e2-c17c-4035-8e41-2db86264ffc5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.647868] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3be55e2-c17c-4035-8e41-2db86264ffc5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.693296] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 740.693296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.693296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.693296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.693296] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.694100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.694100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.694100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.694100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.694100] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.150901] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.153264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.153264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.153264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.153264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.153264] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port c3be55e2-c17c-4035-8e41-2db86264ffc5 not found, creating... [ 741.153264] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.153264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.153264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.153264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.153505] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.153847] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.154127] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.154891] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.155131] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.155274] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.156027] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: c3be55e2-c17c-4035-8e41-2db86264ffc5 is going to be created. [ 741.187303] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.187589] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.188495] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.189238] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.189499] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.189736] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-c3be55e2-c17c-4035-8e41-2db86264ffc5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.197134] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.701481] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.808530] env[69358]: INFO networking_nsxv3.common.synchronization [None req-5b496bac-c0dd-4cc5-8e0b-b3fe771771b6 None None] Enqueued Resource ID: 6a4b9665-fe8d-443a-acc0-f3e59199d0b6 with Priority: HIGHEST for action port [ 741.808530] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a4b9665-fe8d-443a-acc0-f3e59199d0b6 with Priority: HIGHEST for action port [ 741.808530] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a4b9665-fe8d-443a-acc0-f3e59199d0b6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.808530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a4b9665-fe8d-443a-acc0-f3e59199d0b6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.808530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a4b9665-fe8d-443a-acc0-f3e59199d0b6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.808530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a4b9665-fe8d-443a-acc0-f3e59199d0b6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.808530] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4b9665-fe8d-443a-acc0-f3e59199d0b6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.170032] env[69358]: INFO networking_nsxv3.common.synchronization [req-6fa9b3e7-0868-48a5-9d01-a2a0389d56e3 req-fe04c3bf-ba60-4cce-8aba-3cd953f78ee7 service nova] Enqueued Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGHEST for action security_group_rules [ 742.170032] env[69358]: INFO networking_nsxv3.common.synchronization [req-6fa9b3e7-0868-48a5-9d01-a2a0389d56e3 req-fe04c3bf-ba60-4cce-8aba-3cd953f78ee7 service nova] Enqueued Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGHEST for action security_group_members [ 742.170032] env[69358]: INFO networking_nsxv3.common.synchronization [req-6fa9b3e7-0868-48a5-9d01-a2a0389d56e3 req-fe04c3bf-ba60-4cce-8aba-3cd953f78ee7 service nova] Enqueued Resource ID: c3be55e2-c17c-4035-8e41-2db86264ffc5 with Priority: HIGHEST for action port [ 742.170032] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGHEST for action security_group_rules [ 742.170032] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGHEST for action security_group_members [ 742.170032] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3be55e2-c17c-4035-8e41-2db86264ffc5 with Priority: HIGHEST for action port [ 742.170945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.171661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.171975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.173559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.173682] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.175248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.175414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.175523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.175794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.176205] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.176607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.176607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.177563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.177682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.177823] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.178900] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3be55e2-c17c-4035-8e41-2db86264ffc5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.178980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3be55e2-c17c-4035-8e41-2db86264ffc5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.179106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3be55e2-c17c-4035-8e41-2db86264ffc5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.179406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3be55e2-c17c-4035-8e41-2db86264ffc5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.179502] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3be55e2-c17c-4035-8e41-2db86264ffc5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.205960] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.205960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.205960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.205960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.205960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.205960] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 742.232570] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.232786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.232927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.233335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.233513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.243051] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 742.317558] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a4b9665-fe8d-443a-acc0-f3e59199d0b6 [ 742.317558] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.317558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.317558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.317558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.317558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.317558] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a4b9665-fe8d-443a-acc0-f3e59199d0b6 already deleted. [ 742.317558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a4b9665-fe8d-443a-acc0-f3e59199d0b6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.683616] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.683771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.683937] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.684869] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3be55e2-c17c-4035-8e41-2db86264ffc5 with status ACTIVE [ 742.685072] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.685200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.685284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.685447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.685534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.685706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.685803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.685865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.687717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.687815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.688328] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.688482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.688482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.688668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.688732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.688826] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3be55e2-c17c-4035-8e41-2db86264ffc5 is going to be updated. [ 742.711872] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.712031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.712141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.712291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.712416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.712844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3be55e2-c17c-4035-8e41-2db86264ffc5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.191471] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.693592] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.693712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.693787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.694040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.694137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.694238] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa is going to be created. [ 743.721617] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.721617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.721617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.721617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.721617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.729183] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa in Status: UNINITIALIZED for 2s [ 744.122288] env[69358]: INFO networking_nsxv3.common.synchronization [None req-1dbf028e-6d80-4baa-bac9-56670eea9801 None None] Enqueued Resource ID: 3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3 with Priority: HIGHEST for action port [ 744.122288] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3 with Priority: HIGHEST for action port [ 744.123264] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.123393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.123481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.123780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.123886] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.125413] env[69358]: INFO networking_nsxv3.common.synchronization [None req-2dcbb3f4-4a5a-4a96-8bde-de1220c43213 None None] Enqueued Resource ID: c37e8672-7150-490a-87bb-76ad89e267d9 with Priority: HIGHEST for action port [ 744.125980] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37e8672-7150-490a-87bb-76ad89e267d9 with Priority: HIGHEST for action port [ 744.126271] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-c37e8672-7150-490a-87bb-76ad89e267d9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.126389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c37e8672-7150-490a-87bb-76ad89e267d9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.126459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c37e8672-7150-490a-87bb-76ad89e267d9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.126670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c37e8672-7150-490a-87bb-76ad89e267d9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.126750] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c37e8672-7150-490a-87bb-76ad89e267d9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.255221] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 744.255221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.255221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.255864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.256087] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.256211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.256288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.257279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.257525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.257673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.257843] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.626356] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3 [ 744.626534] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.626659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.626767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.626942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.627102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.627222] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3 already deleted. [ 744.627340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab6f12b-5a79-4b02-8999-eb72a5e7c8a3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.629246] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c37e8672-7150-490a-87bb-76ad89e267d9 [ 744.629424] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.629536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.629866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.629866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.629866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.629976] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c37e8672-7150-490a-87bb-76ad89e267d9 already deleted. [ 744.630036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c37e8672-7150-490a-87bb-76ad89e267d9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.763499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.763499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.763499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.763499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.763499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.764210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.764210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.764210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.764210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.764210] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.267324] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6825e81-3f64-4e7b-908b-47b35fcde1e2: rpc.has_security_group_logging(os_id): False [ 745.288278] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.288431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.288504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.288752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.288859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.289077] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.289181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.289244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.289406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.289484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.289685] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.289784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.289848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.289990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.290094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.290278] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.290373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.290434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.290574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.290649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.290734] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 745.349827] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.350258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.350359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.350661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.350799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.353333] env[69358]: INFO networking_nsxv3.common.synchronization [None req-105caf00-7575-466e-8624-a27813e000fd tempest-ImagesOneServerNegativeTestJSON-962105235 tempest-ImagesOneServerNegativeTestJSON-962105235-project-member] Enqueued Resource ID: 5a988900-3ad1-4a0b-a1eb-a8b61e2bea98 with Priority: HIGHEST for action security_group_rules [ 745.354394] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a988900-3ad1-4a0b-a1eb-a8b61e2bea98 with Priority: HIGHEST for action security_group_rules [ 745.355094] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.355245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.355334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.355821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.355945] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a988900-3ad1-4a0b-a1eb-a8b61e2bea98',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.365725] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 745.453105] env[69358]: INFO networking_nsxv3.common.synchronization [None req-10bc87db-7789-4f63-9f0a-41ff72d3c4f1 tempest-ImagesOneServerNegativeTestJSON-962105235 tempest-ImagesOneServerNegativeTestJSON-962105235-project-member] Enqueued Resource ID: 5a988900-3ad1-4a0b-a1eb-a8b61e2bea98 with Priority: HIGHEST for action security_group_rules [ 745.453105] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a988900-3ad1-4a0b-a1eb-a8b61e2bea98 with Priority: HIGHEST for action security_group_rules [ 745.453105] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.453105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.738966] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa in Status: SUCCESS [ 745.739242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.739434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.739582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.739772] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.739897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.739961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.740152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.740422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.740422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.740422] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.808572] env[69358]: INFO networking_nsxv3.common.synchronization [None req-16b44d23-8726-4e17-b9f2-1c2bda12782e tempest-ServerActionsTestOtherB-1009679498 tempest-ServerActionsTestOtherB-1009679498-project-member] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 745.809115] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 745.809417] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.809541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.809608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.813678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.813767] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.878839] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.878996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.879108] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.879402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.879542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.879687] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a988900-3ad1-4a0b-a1eb-a8b61e2bea98 already deleted. [ 745.879838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.880546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.880813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.880939] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a988900-3ad1-4a0b-a1eb-a8b61e2bea98',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.962970] env[69358]: INFO networking_nsxv3.common.synchronization [None req-97dc2139-077d-4db5-b165-d8d18656a7cf tempest-ServerActionsTestOtherB-1009679498 tempest-ServerActionsTestOtherB-1009679498-project-member] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 745.963178] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 745.965675] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.965825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.243212] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.246103] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.246103] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.246103] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.246103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.246740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.246740] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.444057] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.444384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.444384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.444549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.444677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.444792] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b already deleted. [ 746.444899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.445281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.445378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.445471] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.447172] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.447317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.447402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.447581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.447668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.447756] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a988900-3ad1-4a0b-a1eb-a8b61e2bea98 already deleted. [ 746.447838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a988900-3ad1-4a0b-a1eb-a8b61e2bea98" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.465243] env[69358]: INFO networking_nsxv3.common.synchronization [None req-2d664e04-e46c-4285-a5f2-20ad6d435af6 None None] Enqueued Resource ID: 80c49799-4ba4-4b10-8b93-c9403c235167 with Priority: HIGHEST for action port [ 746.465863] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c49799-4ba4-4b10-8b93-c9403c235167 with Priority: HIGHEST for action port [ 746.466257] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-80c49799-4ba4-4b10-8b93-c9403c235167 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.467295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80c49799-4ba4-4b10-8b93-c9403c235167" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.467295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80c49799-4ba4-4b10-8b93-c9403c235167" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.467295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80c49799-4ba4-4b10-8b93-c9403c235167" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.467295] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80c49799-4ba4-4b10-8b93-c9403c235167',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.748580] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 458cc6cf-d8de-4e92-b69d-a92c283ddbaa: rpc.has_security_group_logging(os_id): False [ 746.766537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.766706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.766775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.768179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.768179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.768179] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.768179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.768179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.768179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.768179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.768179] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.768179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.768179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.768452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.768452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.768543] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.768636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.768715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.768883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.768963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.769241] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa is going to be created. [ 746.824223] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.825223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.825223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.825223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.825223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.836913] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa in Status: IN_PROGRESS for 2s [ 746.969229] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.969381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.969476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.969776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.969928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.970451] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b already deleted. [ 746.970564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.972043] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80c49799-4ba4-4b10-8b93-c9403c235167 [ 746.973409] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.973409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.973409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.973409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.973409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.973409] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80c49799-4ba4-4b10-8b93-c9403c235167 already deleted. [ 746.973409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80c49799-4ba4-4b10-8b93-c9403c235167" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.378057] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 747.378431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.836740] env[69358]: INFO networking_nsxv3.common.synchronization [req-6c2beed6-5dc0-47a1-ac0d-d057c36522b1 req-1d81201a-c291-4bfb-9f2a-e4ebe14a77ff tempest-ImagesOneServerTestJSON-2017661083 tempest-ImagesOneServerTestJSON-2017661083-project-member] Enqueued Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGHEST for action security_group_members [ 747.837318] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGHEST for action security_group_members [ 747.840754] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.840754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.840754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.840754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.840754] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.840754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.840754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.840754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.840754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.840754] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.262465] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-817 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.262668] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-817" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.262794] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-817" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.263250] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-817" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.263550] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.263743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.263901] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.264210] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.264395] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.264634] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.264818] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.265030] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.265192] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.265336] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.265475] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.265664] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.285537] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.285759] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.285935] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.286161] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-817" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.286535] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-69274d83-5e24-458d-90a4-86a93687ce1e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.286742] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-69274d83-5e24-458d-90a4-86a93687ce1e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.286877] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-69274d83-5e24-458d-90a4-86a93687ce1e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.287231] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-69274d83-5e24-458d-90a4-86a93687ce1e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.287395] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69274d83-5e24-458d-90a4-86a93687ce1e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.344511] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.344511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.344511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.344511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.344511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.345840] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.345840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.345840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.345840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.345840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.345840] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a already deleted. [ 748.345840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.793351] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.793351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.793351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.793351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.793351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.793351] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 69274d83-5e24-458d-90a4-86a93687ce1e not found, creating... [ 748.793351] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.793351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.793351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.793351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.793351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.793668] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.793668] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.794116] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.794773] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.795052] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.796749] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 69274d83-5e24-458d-90a4-86a93687ce1e is going to be created. [ 748.816021] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.816021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.816021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.816021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.816021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.816021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-69274d83-5e24-458d-90a4-86a93687ce1e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.847918] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa in Status: SUCCESS [ 748.847918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.690088] env[69358]: INFO networking_nsxv3.common.synchronization [req-6c2beed6-5dc0-47a1-ac0d-d057c36522b1 req-b607355a-87d1-489a-bff8-2481eb5200c7 service nova] Enqueued Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGHEST for action security_group_rules [ 749.690255] env[69358]: INFO networking_nsxv3.common.synchronization [req-6c2beed6-5dc0-47a1-ac0d-d057c36522b1 req-b607355a-87d1-489a-bff8-2481eb5200c7 service nova] Enqueued Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGHEST for action security_group_members [ 749.690397] env[69358]: INFO networking_nsxv3.common.synchronization [req-6c2beed6-5dc0-47a1-ac0d-d057c36522b1 req-b607355a-87d1-489a-bff8-2481eb5200c7 service nova] Enqueued Resource ID: 69274d83-5e24-458d-90a4-86a93687ce1e with Priority: HIGHEST for action port [ 749.690630] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGHEST for action security_group_rules [ 749.690762] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGHEST for action security_group_members [ 749.690903] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69274d83-5e24-458d-90a4-86a93687ce1e with Priority: HIGHEST for action port [ 749.691736] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.691869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.691869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.692206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.692295] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.693172] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.693293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.693361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.693539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.693691] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.693797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.693837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.693978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.694088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.694180] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.696910] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-69274d83-5e24-458d-90a4-86a93687ce1e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.697320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69274d83-5e24-458d-90a4-86a93687ce1e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.697395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69274d83-5e24-458d-90a4-86a93687ce1e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.697605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69274d83-5e24-458d-90a4-86a93687ce1e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.697661] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69274d83-5e24-458d-90a4-86a93687ce1e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.934581] env[69358]: INFO networking_nsxv3.common.synchronization [req-9170c696-9ce9-4baa-b4ff-9fe323575574 req-2608f253-d5b3-4ae6-a0cf-a4967777f405 tempest-FloatingIPsAssociationNegativeTestJSON-939904867 tempest-FloatingIPsAssociationNegativeTestJSON-939904867-project-member] Enqueued Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGHEST for action security_group_members [ 749.936049] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGHEST for action security_group_members [ 749.937976] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2fd29d-e8c3-4394-a485-44391d15526c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.938083] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.938219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.938454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.938620] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.938728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.938809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.939016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.939113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.939215] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.199401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.199557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.199722] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.200971] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69274d83-5e24-458d-90a4-86a93687ce1e with status ACTIVE [ 750.201199] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.201328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.201395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.201599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.201681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.201854] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.202237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.202237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.202237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.202369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.202499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.202591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.202649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.202785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.202856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.202939] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69274d83-5e24-458d-90a4-86a93687ce1e is going to be updated. [ 750.224998] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.224998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.224998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.224998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.224998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.224998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69274d83-5e24-458d-90a4-86a93687ce1e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.443357] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.443357] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.443357] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2fd29d-e8c3-4394-a485-44391d15526c is going to be updated. [ 750.479267] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.479405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.479473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.480039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.480039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.489254] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2fd29d-e8c3-4394-a485-44391d15526c in Status: IN_PROGRESS for 2s [ 750.706240] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.209196] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.209196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.209543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.209543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.209543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.209643] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a is going to be created. [ 751.255545] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.255545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.255545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.255545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.255545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.265284] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a in Status: UNINITIALIZED for 2s [ 752.501600] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2fd29d-e8c3-4394-a485-44391d15526c in Status: SUCCESS [ 752.501600] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2fd29d-e8c3-4394-a485-44391d15526c deletion is rescheduled due to dependency. [ 752.501600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.704635] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-060548b0-2800-4210-a5c6-17ffcd6b2041 tempest-ListServersNegativeTestJSON-1543194324 tempest-ListServersNegativeTestJSON-1543194324-project-member] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 752.705335] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 752.706166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.706166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.706166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.706166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.706166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.706166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.706440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.706440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.706440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.706551] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.210580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.210580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.210580] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 already deleted. [ 753.210580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.275727] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a in Status: SUCCESS [ 753.275900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.276080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.276372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.276483] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.277270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.277270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.277270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.277270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.277270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.277270] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.456896] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.461018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.461018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.461018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.461018] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.461018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.461018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.461018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.461018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.461018] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.461018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.461018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.461018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.461018] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.461018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.461018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.478469] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.480884] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.480884] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.481136] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.481581] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-ac926c38-6684-432d-820c-2de4f1187d91 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.482183] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-ac926c38-6684-432d-820c-2de4f1187d91" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.482378] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-ac926c38-6684-432d-820c-2de4f1187d91" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.482725] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-ac926c38-6684-432d-820c-2de4f1187d91" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.483211] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac926c38-6684-432d-820c-2de4f1187d91',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.780139] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.780540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.780540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.780695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.780904] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.781102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.781807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.782210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.782310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.782407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.782707] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.782818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.782883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.783093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.783247] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.783387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.783465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.784681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.784681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.784681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.784681] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.986409] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.986600] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.986734] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.987027] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.987181] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.987337] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port ac926c38-6684-432d-820c-2de4f1187d91 not found, creating... [ 753.987599] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.987789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.988009] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.988218] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.988400] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.988691] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.988852] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.988974] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.989835] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.990029] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.990213] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: ac926c38-6684-432d-820c-2de4f1187d91 is going to be created. [ 754.015267] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.015267] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.015267] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.015267] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.015267] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.015267] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-ac926c38-6684-432d-820c-2de4f1187d91" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.287181] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e7da1ca-32ca-4463-86e0-e62b1a908a4a: rpc.has_security_group_logging(os_id): False [ 754.304262] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.304419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.304491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.304712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.304804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.304994] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.306022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.306363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.307263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.307733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.308498] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.308498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.308498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.309239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.309335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.309588] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.309695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.309770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.310500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.310654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.311543] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a is going to be created. [ 754.366390] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.366893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.366893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.367170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.367755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.377495] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a in Status: IN_PROGRESS for 2s [ 754.720502] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-a5200268-780c-4472-8638-d5de740638b5 service nova] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_rules [ 754.720502] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-a5200268-780c-4472-8638-d5de740638b5 service nova] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 754.720502] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-a5200268-780c-4472-8638-d5de740638b5 service nova] Enqueued Resource ID: ac926c38-6684-432d-820c-2de4f1187d91 with Priority: HIGHEST for action port [ 754.720696] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_rules [ 754.720696] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 754.720751] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac926c38-6684-432d-820c-2de4f1187d91 with Priority: HIGHEST for action port [ 754.721325] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.722102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.722102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.722102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.722102] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.722716] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.722833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.722886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.723082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.723949] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.723949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.723949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.723949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.723949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.723949] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.724451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac926c38-6684-432d-820c-2de4f1187d91 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.725026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac926c38-6684-432d-820c-2de4f1187d91" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.725026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac926c38-6684-432d-820c-2de4f1187d91" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.725026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac926c38-6684-432d-820c-2de4f1187d91" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.725026] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac926c38-6684-432d-820c-2de4f1187d91',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.070869] env[69358]: INFO networking_nsxv3.common.synchronization [None req-a7a87281-f9f3-4c6a-ae17-fba9bcb4437e None None] Enqueued Resource ID: 8308440d-10b0-4140-b877-e5f7c39437d9 with Priority: HIGHEST for action port [ 755.071172] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8308440d-10b0-4140-b877-e5f7c39437d9 with Priority: HIGHEST for action port [ 755.071719] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-8308440d-10b0-4140-b877-e5f7c39437d9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.071841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8308440d-10b0-4140-b877-e5f7c39437d9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.071907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8308440d-10b0-4140-b877-e5f7c39437d9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.072350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8308440d-10b0-4140-b877-e5f7c39437d9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.072432] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8308440d-10b0-4140-b877-e5f7c39437d9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.226879] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.228205] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.228315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.228526] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac926c38-6684-432d-820c-2de4f1187d91 with status ACTIVE [ 755.228694] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.228807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.228875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.229188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.229299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.229489] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.229592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.229654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.229819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.229900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.230088] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.230228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.230276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.230470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.230556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.230642] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac926c38-6684-432d-820c-2de4f1187d91 is going to be updated. [ 755.253089] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.253254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.253317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.253549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.253684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.253861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac926c38-6684-432d-820c-2de4f1187d91" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.576215] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8308440d-10b0-4140-b877-e5f7c39437d9 [ 755.577736] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.577736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.577736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.577736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.577736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.577736] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8308440d-10b0-4140-b877-e5f7c39437d9 already deleted. [ 755.577736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8308440d-10b0-4140-b877-e5f7c39437d9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.733359] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.235596] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.236115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.236115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.236115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.236223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.236262] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be created. [ 756.260176] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.260365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.260417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.260617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.260774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.276549] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: UNINITIALIZED for 2s [ 756.389058] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a in Status: SUCCESS [ 756.389325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.592643] env[69358]: INFO networking_nsxv3.common.synchronization [None req-a4e41cc5-0a51-4923-93aa-7c45e4139102 tempest-ServersTestFqdnHostnames-758146594 tempest-ServersTestFqdnHostnames-758146594-project-member] Enqueued Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_rules [ 756.593237] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_rules [ 756.593597] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4d32ff-0296-4f24-a97d-f033779cef5a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.593728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.593839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.594072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.594171] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.673521] env[69358]: INFO networking_nsxv3.common.synchronization [None req-815fb68b-f54d-47f2-b1b0-697681d6f382 tempest-ServersTestFqdnHostnames-758146594 tempest-ServersTestFqdnHostnames-758146594-project-member] Enqueued Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_rules [ 756.674214] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_rules [ 756.674459] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4d32ff-0296-4f24-a97d-f033779cef5a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.674570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.117476] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.117646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.117694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.118329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.118329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.118329] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4d32ff-0296-4f24-a97d-f033779cef5a already deleted. [ 757.118329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.120187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.120472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.120542] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.260537] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-55651f6f-1df8-4fdf-8789-9a6a4de403ee tempest-ListServersNegativeTestJSON-1543194324 tempest-ListServersNegativeTestJSON-1543194324-project-member] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 757.261418] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 757.261514] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.261648] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.466983] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ff62c8d9-c2c6-42b0-807e-761c63bb9b47 None None] Enqueued Resource ID: a1fa4af7-dddf-4403-ace5-c7c7f589748f with Priority: HIGHEST for action port [ 757.467304] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1fa4af7-dddf-4403-ace5-c7c7f589748f with Priority: HIGHEST for action port [ 757.467848] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1fa4af7-dddf-4403-ace5-c7c7f589748f taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.467972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1fa4af7-dddf-4403-ace5-c7c7f589748f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.468061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1fa4af7-dddf-4403-ace5-c7c7f589748f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.468301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1fa4af7-dddf-4403-ace5-c7c7f589748f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.468381] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1fa4af7-dddf-4403-ace5-c7c7f589748f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.645493] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.645683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.645745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.646007] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.646119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.646221] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4d32ff-0296-4f24-a97d-f033779cef5a already deleted. [ 757.646306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.648170] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.649055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.649055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.649055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.649055] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.649418] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.649418] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.649844] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.649844] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.650083] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.650083] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.650194] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.650301] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.650529] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.650695] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.650780] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.669018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.669018] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.669018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.669018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.669018] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.669018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.669018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.669644] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.669985] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cffa4b64-fdd2-4032-a5a5-bc0746b59e92',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.972183] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1fa4af7-dddf-4403-ace5-c7c7f589748f [ 757.972183] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.972183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.972183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.972183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.972183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.972183] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1fa4af7-dddf-4403-ace5-c7c7f589748f already deleted. [ 757.972183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1fa4af7-dddf-4403-ace5-c7c7f589748f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.174969] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.175180] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.175264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.175584] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.175747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.175906] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port cffa4b64-fdd2-4032-a5a5-bc0746b59e92 not found, creating... [ 758.176212] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.176377] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.176495] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.176716] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.176853] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.180505] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.180713] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.180824] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.181290] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.181486] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.181625] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: cffa4b64-fdd2-4032-a5a5-bc0746b59e92 is going to be created. [ 758.202748] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.203071] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.203213] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.203572] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.203806] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.204043] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.285807] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 758.286121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.286217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.286431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.286625] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.286745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.286809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.286952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.287047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.287138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.287245] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.292074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.292074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.292074] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.292074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.292074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.292074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.292074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.292074] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.792558] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.792558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.793368] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.971389] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-cc901e09-bd61-43fd-b287-8e0b50ae985c service nova] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_rules [ 758.971553] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-cc901e09-bd61-43fd-b287-8e0b50ae985c service nova] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 758.971679] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-cc901e09-bd61-43fd-b287-8e0b50ae985c service nova] Enqueued Resource ID: cffa4b64-fdd2-4032-a5a5-bc0746b59e92 with Priority: HIGHEST for action port [ 758.971932] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_rules [ 758.972088] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 758.972229] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cffa4b64-fdd2-4032-a5a5-bc0746b59e92 with Priority: HIGHEST for action port [ 758.972821] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.972995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.973154] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.973219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.973577] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.973577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.973577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.973798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.973850] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cffa4b64-fdd2-4032-a5a5-bc0746b59e92',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.297127] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.477773] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cffa4b64-fdd2-4032-a5a5-bc0746b59e92 with status ACTIVE [ 759.478103] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.478278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.478385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.478621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.478744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.478957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.479126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.479187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.479345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.479432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.479650] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.479750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.479820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.479988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.480080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.480196] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cffa4b64-fdd2-4032-a5a5-bc0746b59e92 is going to be updated. [ 759.501425] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.501730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.501854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.502124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.502343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.502582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cffa4b64-fdd2-4032-a5a5-bc0746b59e92" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.800715] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.800715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.800715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.800715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.800715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.800715] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 759.846133] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.846133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.846133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.846133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.846133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.852449] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 760.371100] env[69358]: INFO networking_nsxv3.common.synchronization [req-cc1fa23b-e6a7-46b7-85fb-cfefc478a85a req-57b92759-411b-4913-b8c6-e82574ab1e2f tempest-AttachInterfacesV270Test-1511023883 tempest-AttachInterfacesV270Test-1511023883-project-member] Enqueued Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGHEST for action security_group_members [ 760.372294] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGHEST for action security_group_members [ 760.372749] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.372858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.372908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.373141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.373944] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.373944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.373944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.373944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.373944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.373944] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.876590] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.876770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.876843] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.877122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.877223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.877434] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.877571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.877637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.877815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.877894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.878022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa is going to be updated. [ 760.914937] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.915102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.915172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.915379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.915515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.925569] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa in Status: IN_PROGRESS for 2s [ 761.862138] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 761.862138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.862138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.862138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.862624] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.862624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.862624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.862949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.862998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.863166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.863322] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.864454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.864454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.864454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.864454] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.864454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.864454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.864454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.864454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.864454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.865270] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.865371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.865827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.867806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.867806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.867806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.867806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.867806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.867806] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.142736] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-938ad3aa-d147-49b9-8c39-91001126e446 tempest-ListServersNegativeTestJSON-1543194324 tempest-ListServersNegativeTestJSON-1543194324-project-member] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 762.143093] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 762.143627] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.143736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.369960] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a63445e5-d5fa-4b5f-aefd-36f6c4ad7252: rpc.has_security_group_logging(os_id): False [ 762.369960] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.388216] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.388418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.388418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.389151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.389151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.389151] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.389151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.389151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.389419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.389419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.389477] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.389544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.391078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.391078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.391078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.391078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.391078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.391078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.391078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.391078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.391078] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be created. [ 762.440717] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.440874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.440947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.441203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.441385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.454407] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 762.520840] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.520996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.521128] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.521439] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.521701] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.521865] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.521972] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.522323] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.522509] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.522717] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.522825] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.522915] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.523062] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.523136] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.523243] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.523370] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.541480] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.541663] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.541841] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.542035] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-844" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.542495] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e4ca11ec-7d99-431b-9ccf-d45ef553187b taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.542687] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e4ca11ec-7d99-431b-9ccf-d45ef553187b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.542925] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e4ca11ec-7d99-431b-9ccf-d45ef553187b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.543189] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e4ca11ec-7d99-431b-9ccf-d45ef553187b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.543333] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4ca11ec-7d99-431b-9ccf-d45ef553187b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.874212] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.937023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa in Status: SUCCESS [ 762.937267] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa deletion is rescheduled due to dependency. [ 762.937338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.045647] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.045941] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.045941] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.046311] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.046468] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.046627] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e4ca11ec-7d99-431b-9ccf-d45ef553187b not found, creating... [ 763.046901] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.047075] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.047197] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.048560] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.048772] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.050268] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.050268] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.050268] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.050268] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.050489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.050489] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e4ca11ec-7d99-431b-9ccf-d45ef553187b is going to be created. [ 763.074984] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.074984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.074984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.075225] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.075394] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.075677] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e4ca11ec-7d99-431b-9ccf-d45ef553187b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.379913] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.379913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.379913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.379913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.379913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.379913] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 763.410259] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.410420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.410458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.410694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.410868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.420717] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 764.133287] env[69358]: INFO networking_nsxv3.common.synchronization [req-579e046d-1f42-4ade-a665-b1bb1e107c65 req-ac96f32d-8dc8-4cd2-8671-fd8ad84c3629 tempest-ListServerFiltersTestJSON-1173311410 tempest-ListServerFiltersTestJSON-1173311410-project-member] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 764.134589] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 764.134959] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.135149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.135260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.135568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.135701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.135844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.135943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.136145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.136288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.136390] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.167015] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-96ab711d-1c20-4a27-a09f-a83903e7430c service nova] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_rules [ 764.167723] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-96ab711d-1c20-4a27-a09f-a83903e7430c service nova] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 764.167943] env[69358]: INFO networking_nsxv3.common.synchronization [req-f46e505c-dbe3-458c-8d76-2a3303af5354 req-96ab711d-1c20-4a27-a09f-a83903e7430c service nova] Enqueued Resource ID: e4ca11ec-7d99-431b-9ccf-d45ef553187b with Priority: HIGHEST for action port [ 764.170181] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_rules [ 764.170181] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 764.170181] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca11ec-7d99-431b-9ccf-d45ef553187b with Priority: HIGHEST for action port [ 764.170181] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.170181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.170181] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.170181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.170181] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4ca11ec-7d99-431b-9ccf-d45ef553187b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.170955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4ca11ec-7d99-431b-9ccf-d45ef553187b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.171109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4ca11ec-7d99-431b-9ccf-d45ef553187b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.171400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4ca11ec-7d99-431b-9ccf-d45ef553187b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.171536] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4ca11ec-7d99-431b-9ccf-d45ef553187b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.471371] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 764.471371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.471371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.471371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.471371] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.620811] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c2ae1ce2-292e-4588-b5e5-9697cdf1659d None None] Enqueued Resource ID: a31354f7-defe-4e5c-8e10-125ffc7122cc with Priority: HIGHEST for action port [ 764.621469] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31354f7-defe-4e5c-8e10-125ffc7122cc with Priority: HIGHEST for action port [ 764.621771] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a31354f7-defe-4e5c-8e10-125ffc7122cc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.621889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a31354f7-defe-4e5c-8e10-125ffc7122cc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.621955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a31354f7-defe-4e5c-8e10-125ffc7122cc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.622309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a31354f7-defe-4e5c-8e10-125ffc7122cc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.622396] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a31354f7-defe-4e5c-8e10-125ffc7122cc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.639846] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.676407] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4ca11ec-7d99-431b-9ccf-d45ef553187b with status ACTIVE [ 764.676407] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.676407] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.676407] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.676407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.676407] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4ca11ec-7d99-431b-9ccf-d45ef553187b is going to be updated. [ 764.720159] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.720159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.720159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.720159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.720159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.720159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4ca11ec-7d99-431b-9ccf-d45ef553187b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.975328] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.975328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.125606] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a31354f7-defe-4e5c-8e10-125ffc7122cc [ 765.125606] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.125606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.125606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.125809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.125809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.125870] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a31354f7-defe-4e5c-8e10-125ffc7122cc already deleted. [ 765.125917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a31354f7-defe-4e5c-8e10-125ffc7122cc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.144610] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.430142] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 765.430142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.430405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.430661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.430854] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.430980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.431060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.431640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.431755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.431859] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.647794] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.647964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.648053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.648281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.648375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.648476] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 765.675957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.676121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.676237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.676461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.676592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.684620] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 765.909584] env[69358]: INFO networking_nsxv3.common.synchronization [None req-90d339c6-a16e-4ea0-9a48-13a4314e0c53 tempest-MigrationsAdminTest-1296336123 tempest-MigrationsAdminTest-1296336123-project-member] Enqueued Resource ID: 75fc788b-d0bd-4780-b704-092ee9bc37bc with Priority: HIGHEST for action security_group_rules [ 765.910249] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75fc788b-d0bd-4780-b704-092ee9bc37bc with Priority: HIGHEST for action security_group_rules [ 765.910927] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75fc788b-d0bd-4780-b704-092ee9bc37bc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.911097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75fc788b-d0bd-4780-b704-092ee9bc37bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.911256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75fc788b-d0bd-4780-b704-092ee9bc37bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.911530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75fc788b-d0bd-4780-b704-092ee9bc37bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.911654] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75fc788b-d0bd-4780-b704-092ee9bc37bc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.938091] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.075276] env[69358]: INFO networking_nsxv3.common.synchronization [None req-d6f93a33-3158-4d2e-b3c7-16dd1011344a tempest-MigrationsAdminTest-1296336123 tempest-MigrationsAdminTest-1296336123-project-member] Enqueued Resource ID: 75fc788b-d0bd-4780-b704-092ee9bc37bc with Priority: HIGHEST for action security_group_rules [ 766.075803] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75fc788b-d0bd-4780-b704-092ee9bc37bc with Priority: HIGHEST for action security_group_rules [ 766.077497] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75fc788b-d0bd-4780-b704-092ee9bc37bc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.077613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75fc788b-d0bd-4780-b704-092ee9bc37bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.434595] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.434595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.434595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.434595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.434595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.435309] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75fc788b-d0bd-4780-b704-092ee9bc37bc already deleted. [ 766.435309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75fc788b-d0bd-4780-b704-092ee9bc37bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.435309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75fc788b-d0bd-4780-b704-092ee9bc37bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.435309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75fc788b-d0bd-4780-b704-092ee9bc37bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.435309] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75fc788b-d0bd-4780-b704-092ee9bc37bc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.442172] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.569632] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ca70cb75-a46a-4afe-9bd5-d41963c845e7 None None] Enqueued Resource ID: b2a1dd3b-8f74-487c-819d-e92e3c03b3e9 with Priority: HIGHEST for action port [ 766.570272] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2a1dd3b-8f74-487c-819d-e92e3c03b3e9 with Priority: HIGHEST for action port [ 766.570608] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2a1dd3b-8f74-487c-819d-e92e3c03b3e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.570727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2a1dd3b-8f74-487c-819d-e92e3c03b3e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.570792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2a1dd3b-8f74-487c-819d-e92e3c03b3e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.571829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2a1dd3b-8f74-487c-819d-e92e3c03b3e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.571976] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a1dd3b-8f74-487c-819d-e92e3c03b3e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.945059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.945286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.945391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.945637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.945766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.945896] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 766.956204] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.956342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.956406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.956608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.956705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.956793] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75fc788b-d0bd-4780-b704-092ee9bc37bc already deleted. [ 766.956870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75fc788b-d0bd-4780-b704-092ee9bc37bc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.982884] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.983060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.983134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.983341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.983488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.000090] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 767.074785] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2a1dd3b-8f74-487c-819d-e92e3c03b3e9 [ 767.077530] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.077530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.077530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.077530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.077530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.077530] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2a1dd3b-8f74-487c-819d-e92e3c03b3e9 already deleted. [ 767.077530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2a1dd3b-8f74-487c-819d-e92e3c03b3e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.696406] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 767.696733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.012588] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 769.012588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.012848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.012848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.013035] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.013692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.013692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.013692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.013692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.013692] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.518918] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.802727] env[69358]: INFO networking_nsxv3.common.synchronization [req-cac92968-fdc8-4d01-b6e2-e607e794aa2f req-44da30ce-dcbc-4e56-abe5-a8437d411b59 tempest-DeleteServersAdminTestJSON-390053105 tempest-DeleteServersAdminTestJSON-390053105-project-member] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 769.803289] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 769.805037] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.805037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.805037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.805037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.805037] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.805037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.805037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.805037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.805363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.805363] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.021946] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.310650] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.310650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.310650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.310650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.310650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.310957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.310957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.310957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.311247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.311247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.311346] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 is going to be updated. [ 770.340551] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.340551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.340551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.340551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.340551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.349241] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: IN_PROGRESS for 2s [ 770.402883] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.403140] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.403271] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.403546] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.403829] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.403987] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.404145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.404374] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.404524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.404742] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.404858] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.404969] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.405090] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.405200] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.409118] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.409118] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.426662] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.429021] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.429021] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.429021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.429021] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.429021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.429021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.430057] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.430378] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('439101ca-e7f0-4c55-9abb-b3f1f409c7f7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.527240] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.527838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.527838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.527929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.527997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.528153] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 770.555538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.555783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.556689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.556689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.556689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.565016] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 770.932616] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.936055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.936055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.936055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.936055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.936055] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 439101ca-e7f0-4c55-9abb-b3f1f409c7f7 not found, creating... [ 770.936055] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.936055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.936055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.936055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.936055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.936695] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.936695] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.936695] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.936695] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.936695] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.936695] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 439101ca-e7f0-4c55-9abb-b3f1f409c7f7 is going to be created. [ 770.960024] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.960802] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.960802] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.960802] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.961585] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.961585] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.889708] env[69358]: INFO networking_nsxv3.common.synchronization [req-cac92968-fdc8-4d01-b6e2-e607e794aa2f req-aa2b4d1f-b3fc-490d-bd7f-87422afd06fb service nova] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_rules [ 771.889977] env[69358]: INFO networking_nsxv3.common.synchronization [req-cac92968-fdc8-4d01-b6e2-e607e794aa2f req-aa2b4d1f-b3fc-490d-bd7f-87422afd06fb service nova] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 771.890190] env[69358]: INFO networking_nsxv3.common.synchronization [req-cac92968-fdc8-4d01-b6e2-e607e794aa2f req-aa2b4d1f-b3fc-490d-bd7f-87422afd06fb service nova] Enqueued Resource ID: 439101ca-e7f0-4c55-9abb-b3f1f409c7f7 with Priority: HIGHEST for action port [ 771.890853] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_rules [ 771.891059] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 771.891212] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439101ca-e7f0-4c55-9abb-b3f1f409c7f7 with Priority: HIGHEST for action port [ 771.891667] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.891835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.891938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.892225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.892417] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.893502] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.893638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.893909] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.894073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.894176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.894429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.894546] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('439101ca-e7f0-4c55-9abb-b3f1f409c7f7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.155120] env[69358]: INFO networking_nsxv3.common.synchronization [None req-cbe514f3-3530-46f1-97a9-6ec63de75ecd None None] Enqueued Resource ID: 81a4ef74-fdbd-4479-8e65-a3f3bef3d034 with Priority: HIGHEST for action port [ 772.155781] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a4ef74-fdbd-4479-8e65-a3f3bef3d034 with Priority: HIGHEST for action port [ 772.156319] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-81a4ef74-fdbd-4479-8e65-a3f3bef3d034 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.156480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81a4ef74-fdbd-4479-8e65-a3f3bef3d034" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.156566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81a4ef74-fdbd-4479-8e65-a3f3bef3d034" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.156863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81a4ef74-fdbd-4479-8e65-a3f3bef3d034" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.156964] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81a4ef74-fdbd-4479-8e65-a3f3bef3d034',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.358697] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: SUCCESS [ 772.359390] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 deletion is rescheduled due to dependency. [ 772.359390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.359390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.359390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.359633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.359694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.360119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.360119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.360119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.360119] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.396121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.396293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.396530] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 439101ca-e7f0-4c55-9abb-b3f1f409c7f7 with status ACTIVE [ 772.397194] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.397194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.397357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.397492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.397567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.397749] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.397844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.397905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.398064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.398247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.398307] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.398396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.398452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.398602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.398679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.398760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 439101ca-e7f0-4c55-9abb-b3f1f409c7f7 is going to be updated. [ 772.417266] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.417460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.417509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.417713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.417846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.418068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-439101ca-e7f0-4c55-9abb-b3f1f409c7f7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.574709] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 772.574931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.575122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.575335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.575706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.575849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.575941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.576140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.576250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.576339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.576431] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.664016] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81a4ef74-fdbd-4479-8e65-a3f3bef3d034 [ 772.666278] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.666505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.666613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.666861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.666996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.667107] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81a4ef74-fdbd-4479-8e65-a3f3bef3d034 already deleted. [ 772.667188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81a4ef74-fdbd-4479-8e65-a3f3bef3d034" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.863880] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.948266] env[69358]: INFO networking_nsxv3.common.synchronization [req-e3fe5623-094f-46ba-9ecc-4a6bbe8f7bb1 req-a2b00ab1-e494-40c5-b8c3-b90589a9b72a tempest-ServersAdminNegativeTestJSON-1854851698 tempest-ServersAdminNegativeTestJSON-1854851698-project-member] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 772.950079] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 772.951709] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.951709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.951709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.951709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.952141] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.952141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.952213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.953564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.953618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.953796] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.079251] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.079465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.079540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.079764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.079931] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.080049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.080112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.080261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.080341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.080436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.080587] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.080684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.080744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.080954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.081019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.082920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.082920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.082920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.082920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.082920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.082920] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.367076] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.457042] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.457042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.457042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.457386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.457386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.457386] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.457496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.457527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.457667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.457745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.457824] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 already deleted. [ 773.458183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.575019] env[69358]: INFO networking_nsxv3.common.synchronization [req-12900fde-5ede-4c69-885f-162a062799ed req-e4b67de6-47fc-4f2f-84e5-aa95f8a9ab5b tempest-ServersTestManualDisk-96811625 tempest-ServersTestManualDisk-96811625-project-member] Enqueued Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_members [ 773.575730] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGHEST for action security_group_members [ 773.580139] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9495602c-f01c-4935-941b-dacd2d1ea667 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.580338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.580415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.580630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.581206] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.581206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.581206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.581206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.581340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.581340] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.587501] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a63445e5-d5fa-4b5f-aefd-36f6c4ad7252: rpc.has_security_group_logging(os_id): False [ 773.606514] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.606721] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.606845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.607147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.607296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.607637] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.607768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.607832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.608998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.609190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.609401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.609556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.609660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.609854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.609929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.610194] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.610355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.610453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.610677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.610763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.610897] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 773.771286] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.771748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.771748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.771951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.771986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.788018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 773.869304] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.870210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.870210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.870210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.870210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.870390] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 is going to be updated. [ 773.898428] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ef9282fe-53c7-4ee9-b181-fef85ee03b50 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_rules [ 773.898915] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_rules [ 773.899347] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.899476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.899476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.903022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.903022] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.909025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.909190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.909237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.909432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.909574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.919157] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: IN_PROGRESS for 2s [ 774.088788] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.089176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.089850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.089850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.089850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.090020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.090189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.090403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.090520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.090601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.090718] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9495602c-f01c-4935-941b-dacd2d1ea667 is going to be updated. [ 774.117143] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.117334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.117874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.117874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.117874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.126411] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9495602c-f01c-4935-941b-dacd2d1ea667 in Status: IN_PROGRESS for 2s [ 774.147027] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.147318] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.147471] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.147790] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.148126] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.148326] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.148480] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.148742] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.148921] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.149184] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.149407] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.150349] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.150349] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.150349] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.150349] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.150349] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.171098] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.171098] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.171386] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.171518] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.172303] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-9a04bb7a-c618-45da-b189-c25c3ae02d7a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.172549] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-9a04bb7a-c618-45da-b189-c25c3ae02d7a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.172681] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-9a04bb7a-c618-45da-b189-c25c3ae02d7a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.173786] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-9a04bb7a-c618-45da-b189-c25c3ae02d7a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.174032] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a04bb7a-c618-45da-b189-c25c3ae02d7a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.182798] env[69358]: INFO networking_nsxv3.common.synchronization [None req-a9e87612-a554-4662-a1ed-036ade49eb5c tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_rules [ 774.182798] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_rules [ 774.183692] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.184014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.375183] env[69358]: INFO networking_nsxv3.common.synchronization [None req-8d3f80c6-b119-462a-9895-357cd4e90793 None None] Enqueued Resource ID: 02826a26-0393-4cd9-ac85-ed7250219179 with Priority: HIGHEST for action port [ 774.375183] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02826a26-0393-4cd9-ac85-ed7250219179 with Priority: HIGHEST for action port [ 774.381364] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-02826a26-0393-4cd9-ac85-ed7250219179 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.381498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02826a26-0393-4cd9-ac85-ed7250219179" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.381539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02826a26-0393-4cd9-ac85-ed7250219179" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.381920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02826a26-0393-4cd9-ac85-ed7250219179" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.381920] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02826a26-0393-4cd9-ac85-ed7250219179',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.421735] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.422206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.422206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.422293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.422409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.422514] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 already deleted. [ 774.422647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.423606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.423750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.423790] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.678435] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.678789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.678946] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.679268] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.681720] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.681720] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 9a04bb7a-c618-45da-b189-c25c3ae02d7a not found, creating... [ 774.681720] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.681720] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.681992] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.682227] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.682400] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.684339] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.685025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.685025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.685025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.685170] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.685290] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 9a04bb7a-c618-45da-b189-c25c3ae02d7a is going to be created. [ 774.721997] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.722217] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.722341] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.722607] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.722845] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.723130] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-9a04bb7a-c618-45da-b189-c25c3ae02d7a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.888592] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02826a26-0393-4cd9-ac85-ed7250219179 [ 774.888592] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.888592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.888592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.888592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.888592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.888592] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02826a26-0393-4cd9-ac85-ed7250219179 already deleted. [ 774.888592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02826a26-0393-4cd9-ac85-ed7250219179" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.948286] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.948286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.948286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.948286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.948286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.948286] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 already deleted. [ 774.948286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.442675] env[69358]: INFO networking_nsxv3.common.synchronization [req-497b97a9-86be-4d9f-b2da-df2b544ecda4 req-39a3e8b4-3c2d-409c-8a0e-6841f558b2b1 tempest-ListServersNegativeTestJSON-1543194324 tempest-ListServersNegativeTestJSON-1543194324-project-member] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 775.443233] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 775.443529] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.443641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.443705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.443892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.445495] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.445608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.445675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.445944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.446047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.446143] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.667860] env[69358]: INFO networking_nsxv3.common.synchronization [req-e3fe5623-094f-46ba-9ecc-4a6bbe8f7bb1 req-b7734128-d363-48b7-bea4-42e071e410ff service nova] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_rules [ 775.668053] env[69358]: INFO networking_nsxv3.common.synchronization [req-e3fe5623-094f-46ba-9ecc-4a6bbe8f7bb1 req-b7734128-d363-48b7-bea4-42e071e410ff service nova] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 775.668196] env[69358]: INFO networking_nsxv3.common.synchronization [req-e3fe5623-094f-46ba-9ecc-4a6bbe8f7bb1 req-b7734128-d363-48b7-bea4-42e071e410ff service nova] Enqueued Resource ID: 9a04bb7a-c618-45da-b189-c25c3ae02d7a with Priority: HIGHEST for action port [ 775.668449] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_rules [ 775.668582] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 775.668680] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a04bb7a-c618-45da-b189-c25c3ae02d7a with Priority: HIGHEST for action port [ 775.671588] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.672368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.672465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.672825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.672913] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.678083] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.678260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.678321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.679049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.679049] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.679049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.679049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.679256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.679256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.679352] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.680792] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a04bb7a-c618-45da-b189-c25c3ae02d7a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.680925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a04bb7a-c618-45da-b189-c25c3ae02d7a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.680981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a04bb7a-c618-45da-b189-c25c3ae02d7a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.681370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a04bb7a-c618-45da-b189-c25c3ae02d7a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.681370] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a04bb7a-c618-45da-b189-c25c3ae02d7a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.801140] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 775.801294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.801522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.801735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.801823] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.928045] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: SUCCESS [ 775.928234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.928366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.928571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.928772] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.928897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.928968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.929153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.929224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.929304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.929395] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.950482] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.135489] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9495602c-f01c-4935-941b-dacd2d1ea667 in Status: SUCCESS [ 776.135648] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9495602c-f01c-4935-941b-dacd2d1ea667 deletion is rescheduled due to dependency. [ 776.135797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.178605] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.178746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.183611] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a04bb7a-c618-45da-b189-c25c3ae02d7a with status ACTIVE [ 776.184397] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.184397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.184397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.184397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.184397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.184702] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.184702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.184702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.184853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.184927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.185117] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.185438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.185438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.185438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.185438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.185628] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a04bb7a-c618-45da-b189-c25c3ae02d7a is going to be updated. [ 776.189846] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.209338] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.209338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.209338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.209338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.209338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.209338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a04bb7a-c618-45da-b189-c25c3ae02d7a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.304065] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.304065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.432098] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.432098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.432098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.432433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.432726] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.432895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.433029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.433259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.433428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.433604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.433836] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.434019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.434254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.434415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.434606] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.434953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.434953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.435119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.435239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.435358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.435485] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.452891] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.692181] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.940945] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9: rpc.has_security_group_logging(os_id): False [ 776.956459] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.956459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.956459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.956459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.956459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.956459] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 776.958048] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.958198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.958249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.958400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.958483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.958651] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.958744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.958805] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.958942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.959033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.959234] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.959326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.959403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.959589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.959652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.959832] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.959960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.960011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.960121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.960193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.960778] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 is going to be updated. [ 776.984162] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.984328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.984420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.984627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.985202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.993088] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 777.039103] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.039332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.039441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.043020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.043020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.060788] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: IN_PROGRESS for 2s [ 777.197707] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.198608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.198608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.198608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.198608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.198811] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be created. [ 777.233412] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.233551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.233622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.233880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.234051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.244057] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: UNINITIALIZED for 2s [ 777.725195] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4b082a1-87f0-4ed0-b2c6-ea540150fd18 req-02e37837-1a31-4e77-8705-2f680e662004 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_members [ 777.725195] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_members [ 777.725195] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.725195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.725195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.725195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.725195] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.726829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.727114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.727449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.727658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.728491] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.233277] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.233436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.233503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.233856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.233957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.235040] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.235040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.235040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.235040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.235040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.235040] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 already deleted. [ 778.235040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.298658] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.298847] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.298966] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.299461] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.299570] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.300668] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.300668] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.304061] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.304307] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.304625] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.304721] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.304822] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.305054] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.305054] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.305167] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.305301] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.323267] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.323498] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 778.323656] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.323867] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.324219] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-8f5656e2-042d-4609-80c3-22e796bc54ee taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.324430] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-8f5656e2-042d-4609-80c3-22e796bc54ee" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.324605] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-8f5656e2-042d-4609-80c3-22e796bc54ee" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.324949] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-8f5656e2-042d-4609-80c3-22e796bc54ee" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.325745] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f5656e2-042d-4609-80c3-22e796bc54ee',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.829489] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.829777] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.829777] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.830060] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.830873] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.830873] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 8f5656e2-042d-4609-80c3-22e796bc54ee not found, creating... [ 778.830873] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.830873] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.830873] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.831171] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.831204] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.831466] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.831662] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.831777] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.831975] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.832232] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.832370] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 8f5656e2-042d-4609-80c3-22e796bc54ee is going to be created. [ 778.854032] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.854032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.854032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.854032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.854032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.854032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-8f5656e2-042d-4609-80c3-22e796bc54ee" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.008123] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 779.008123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.008123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.008272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.008696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.008696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.008696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.008696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.008902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.008902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.008902] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.074382] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: SUCCESS [ 779.074596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.256945] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: SUCCESS [ 779.256945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.256945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.256945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.256945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.256945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.256945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.256945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.256945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.256945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.256945] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.515526] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.515690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.515755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.516088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.516287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.516451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.516532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.516695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.516838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.516889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.517086] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.517158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.517158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.517294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.517429] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.517516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.517575] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.517706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.521043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.521043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.521043] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.740039] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4b082a1-87f0-4ed0-b2c6-ea540150fd18 req-bf400799-1f9a-444a-9d04-82ddedebb396 service nova] Enqueued Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_rules [ 779.740039] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4b082a1-87f0-4ed0-b2c6-ea540150fd18 req-bf400799-1f9a-444a-9d04-82ddedebb396 service nova] Enqueued Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_members [ 779.740039] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4b082a1-87f0-4ed0-b2c6-ea540150fd18 req-bf400799-1f9a-444a-9d04-82ddedebb396 service nova] Enqueued Resource ID: 8f5656e2-042d-4609-80c3-22e796bc54ee with Priority: HIGHEST for action port [ 779.740039] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_rules [ 779.740039] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_members [ 779.740039] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5656e2-042d-4609-80c3-22e796bc54ee with Priority: HIGHEST for action port [ 779.740039] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.740039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.740039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.741686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.741686] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.743233] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.743384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.743478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.743689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.743927] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.744073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.744159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.744332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.744443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.744563] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.745454] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f5656e2-042d-4609-80c3-22e796bc54ee taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.745656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f5656e2-042d-4609-80c3-22e796bc54ee" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.745706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f5656e2-042d-4609-80c3-22e796bc54ee" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.745891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f5656e2-042d-4609-80c3-22e796bc54ee" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.745994] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f5656e2-042d-4609-80c3-22e796bc54ee',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.758315] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.758467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.758504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.758688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.758842] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.759630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.759630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.759630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.759630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.759630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.759630] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.759630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.759630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.759960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.759960] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.759960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.760065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.760114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.760186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.760264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.760361] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.025224] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a63445e5-d5fa-4b5f-aefd-36f6c4ad7252: rpc.has_security_group_logging(os_id): False [ 780.042059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.042202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.042242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.042437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.042533] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.042783] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.042874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.042941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.043109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.043191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.043363] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.043454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.043512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.043646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.043735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.043902] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.043987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.044067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.044206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.044280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.044363] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 780.097156] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.098335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.098335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.098335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.098491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.112167] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 780.248314] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.248314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.249276] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.250504] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f5656e2-042d-4609-80c3-22e796bc54ee with status ACTIVE [ 780.250504] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.250650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.250726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.250952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.251071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.251265] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.251379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.251441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.251625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.251710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.251893] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.251993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.252166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.252315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.252401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.252487] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f5656e2-042d-4609-80c3-22e796bc54ee is going to be updated. [ 780.263293] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c2d1cb5-beda-4718-964c-8cbc07452049: rpc.has_security_group_logging(os_id): False [ 780.284519] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.284519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.284856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.284856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.284918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.285059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f5656e2-042d-4609-80c3-22e796bc54ee" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.289780] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.290056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.290091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.290299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.290393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.290713] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.290787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.290787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.290943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.291030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.291217] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.291306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.291366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.291503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.291613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.295024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.295024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.295024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.295024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.295024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.295024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be created. [ 780.378503] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.378724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.378802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.379079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.379227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.391713] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: IN_PROGRESS for 2s [ 780.596944] env[69358]: INFO networking_nsxv3.common.synchronization [req-c29adf08-9106-4a08-93c0-753e42f7d0f7 req-681c0f8a-6c1f-4110-a754-3fadf5396b59 tempest-ServerExternalEventsTest-1185170337 tempest-ServerExternalEventsTest-1185170337-project-member] Enqueued Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGHEST for action security_group_members [ 780.596944] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGHEST for action security_group_members [ 780.597305] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18a7451-b9c3-48be-82ef-e20729d3779a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.597418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.597418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.597752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.597953] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.598093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.598151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.598336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.598438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.598572] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.754657] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.105451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.105791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.105791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.105891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.105985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.106197] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.106294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.106374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.106530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.106608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.106694] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18a7451-b9c3-48be-82ef-e20729d3779a already deleted. [ 781.106771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.133933] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.137548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.137548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.137548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.137548] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.137548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.137548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.137548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.137548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.137548] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.137548] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.137548] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.137548] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.137548] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.137548] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.137548] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.153727] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.153727] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 781.153727] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.153907] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.154201] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a26fcb6f-ce0d-4863-9853-ac66d567eecf taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.154371] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a26fcb6f-ce0d-4863-9853-ac66d567eecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.154509] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a26fcb6f-ce0d-4863-9853-ac66d567eecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.155096] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a26fcb6f-ce0d-4863-9853-ac66d567eecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.155252] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a26fcb6f-ce0d-4863-9853-ac66d567eecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.260886] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.261108] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.261160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.261349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.261439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.261558] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 is going to be created. [ 781.291750] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.291899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.291972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.292198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.292366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.303500] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 in Status: UNINITIALIZED for 2s [ 781.658849] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.659266] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.659266] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.659443] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.659628] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.659783] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a26fcb6f-ce0d-4863-9853-ac66d567eecf not found, creating... [ 781.660059] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.660204] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.660323] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.660984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.660984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.660984] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.661995] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.662144] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.662384] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.662525] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.662696] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a26fcb6f-ce0d-4863-9853-ac66d567eecf is going to be created. [ 781.685937] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.686188] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.686326] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.686637] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.686899] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.687180] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a26fcb6f-ce0d-4863-9853-ac66d567eecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.127643] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 782.127980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.405471] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: SUCCESS [ 782.405949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.437188] env[69358]: INFO networking_nsxv3.common.synchronization [req-c29adf08-9106-4a08-93c0-753e42f7d0f7 req-075a450e-9ad1-41c7-8007-0cfbcd87ae56 service nova] Enqueued Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGHEST for action security_group_rules [ 782.437188] env[69358]: INFO networking_nsxv3.common.synchronization [req-c29adf08-9106-4a08-93c0-753e42f7d0f7 req-075a450e-9ad1-41c7-8007-0cfbcd87ae56 service nova] Enqueued Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGHEST for action security_group_members [ 782.437188] env[69358]: INFO networking_nsxv3.common.synchronization [req-c29adf08-9106-4a08-93c0-753e42f7d0f7 req-075a450e-9ad1-41c7-8007-0cfbcd87ae56 service nova] Enqueued Resource ID: a26fcb6f-ce0d-4863-9853-ac66d567eecf with Priority: HIGHEST for action port [ 782.437188] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGHEST for action security_group_rules [ 782.437188] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGHEST for action security_group_members [ 782.437188] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a26fcb6f-ce0d-4863-9853-ac66d567eecf with Priority: HIGHEST for action port [ 782.437606] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d18a7451-b9c3-48be-82ef-e20729d3779a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.437881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.439215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.439762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.439955] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.441391] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18a7451-b9c3-48be-82ef-e20729d3779a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.441648] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.441807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.442205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.442664] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.442880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.443040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.443276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.443454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.443618] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.444520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a26fcb6f-ce0d-4863-9853-ac66d567eecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.444767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a26fcb6f-ce0d-4863-9853-ac66d567eecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.453022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a26fcb6f-ce0d-4863-9853-ac66d567eecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.453022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a26fcb6f-ce0d-4863-9853-ac66d567eecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.453022] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a26fcb6f-ce0d-4863-9853-ac66d567eecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.950747] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18a7451-b9c3-48be-82ef-e20729d3779a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.950747] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.950747] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.951655] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a26fcb6f-ce0d-4863-9853-ac66d567eecf with status ACTIVE [ 782.951879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.951997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.955463] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.955463] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.955463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.955463] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a26fcb6f-ce0d-4863-9853-ac66d567eecf is going to be updated. [ 782.979747] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.980057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.980057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.980354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.980590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.980856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a26fcb6f-ce0d-4863-9853-ac66d567eecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.315534] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 in Status: SUCCESS [ 783.315534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.315534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.315534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.315534] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.315534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.315534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.315534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.315534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.315534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.315534] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.458275] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.819632] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.957637] env[69358]: INFO networking_nsxv3.common.synchronization [req-477cc8ec-eda0-45ed-b8a3-15a8b3d85945 req-ad7cbd2c-ea56-43af-98f9-636406db905c tempest-DeleteServersAdminTestJSON-390053105 tempest-DeleteServersAdminTestJSON-390053105-project-member] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 783.958119] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGHEST for action security_group_members [ 783.958450] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.958528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.958590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.958785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.959360] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.959472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.959593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.959782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.959883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.960028] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.967424] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.967631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.967631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.967778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.967869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.967959] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18a7451-b9c3-48be-82ef-e20729d3779a is going to be created. [ 783.993081] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.993245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.993339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.993510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.993661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.002768] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18a7451-b9c3-48be-82ef-e20729d3779a in Status: UNINITIALIZED for 2s [ 784.324093] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7badac2d-7352-4331-adc3-4bc4f3b30231: rpc.has_security_group_logging(os_id): False [ 784.341383] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.341492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.341549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.341860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.341944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.342370] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.342370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.342370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.342370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.342890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.342890] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 is going to be created. [ 784.407421] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.407573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.407629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.407840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.409381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.421014] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 in Status: IN_PROGRESS for 2s [ 784.465377] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.465377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.465377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.465377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.465377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.465377] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.465377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.465377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.465377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.465377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.465377] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 is going to be updated. [ 784.509180] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.509745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.509745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.509745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.509949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.522612] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: IN_PROGRESS for 2s [ 785.445392] env[69358]: INFO networking_nsxv3.common.synchronization [req-3f4c08e6-30d7-4f63-a390-98ae6777c55d req-422d2248-6b17-4de4-822d-f8fbd0b97349 tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 785.446186] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 785.446556] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.447339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.447339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.447339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.447339] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.447339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.447339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.447596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.447596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.447672] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.857395] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.857593] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.857716] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.858537] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.858537] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.858681] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.858756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.858991] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.859172] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.859389] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.859504] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.859612] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.859719] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.859827] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.859930] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.860074] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.881218] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.881394] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 785.881529] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.881725] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.882078] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4fc66dfb-cd12-45a4-85b4-45ea26512170 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.882244] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4fc66dfb-cd12-45a4-85b4-45ea26512170" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.882361] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4fc66dfb-cd12-45a4-85b4-45ea26512170" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.882699] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4fc66dfb-cd12-45a4-85b4-45ea26512170" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.882879] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc66dfb-cd12-45a4-85b4-45ea26512170',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.950573] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.950573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.950573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.950573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.950802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.950877] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.950965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.951040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.951187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.951297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.951356] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b already deleted. [ 785.951438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.012146] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18a7451-b9c3-48be-82ef-e20729d3779a in Status: SUCCESS [ 786.012368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.012546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.012797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.013057] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.013203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.013279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.013510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.013598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.013688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.013780] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.388758] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.390227] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.390227] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.390227] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.390849] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.391066] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 4fc66dfb-cd12-45a4-85b4-45ea26512170 not found, creating... [ 786.391661] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.391661] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.391859] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.392145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.392145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.392470] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.392702] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.393412] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.393412] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.393412] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.393412] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4fc66dfb-cd12-45a4-85b4-45ea26512170 is going to be created. [ 786.413320] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.413855] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.413855] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.414062] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.414262] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.414528] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4fc66dfb-cd12-45a4-85b4-45ea26512170" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.435049] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 in Status: SUCCESS [ 786.435511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.521538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18a7451-b9c3-48be-82ef-e20729d3779a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.521538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.521538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18a7451-b9c3-48be-82ef-e20729d3779a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.521538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.521538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.522525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.522525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.522525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.522525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.522643] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.538428] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 in Status: SUCCESS [ 786.538695] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 deletion is rescheduled due to dependency. [ 786.538832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.026579] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d18a7451-b9c3-48be-82ef-e20729d3779a: rpc.has_security_group_logging(os_id): False [ 787.044744] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.044893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.044966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.045200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.045291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.045472] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.045569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.045630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.045776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.045849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.046053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.046181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.046258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.047285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.047285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.047285] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.047285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.047573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.047573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.047573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.047573] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d18a7451-b9c3-48be-82ef-e20729d3779a is going to be created. [ 787.127613] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.127762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.127848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.128342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.128558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.141214] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d18a7451-b9c3-48be-82ef-e20729d3779a in Status: IN_PROGRESS for 2s [ 787.447623] env[69358]: INFO networking_nsxv3.common.synchronization [req-3f4c08e6-30d7-4f63-a390-98ae6777c55d req-38976634-6f41-4d3c-8d8a-47354d17f70d service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 787.448155] env[69358]: INFO networking_nsxv3.common.synchronization [req-3f4c08e6-30d7-4f63-a390-98ae6777c55d req-38976634-6f41-4d3c-8d8a-47354d17f70d service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 787.448155] env[69358]: INFO networking_nsxv3.common.synchronization [req-3f4c08e6-30d7-4f63-a390-98ae6777c55d req-38976634-6f41-4d3c-8d8a-47354d17f70d service nova] Enqueued Resource ID: 4fc66dfb-cd12-45a4-85b4-45ea26512170 with Priority: HIGHEST for action port [ 787.448663] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 787.448794] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 787.448910] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc66dfb-cd12-45a4-85b4-45ea26512170 with Priority: HIGHEST for action port [ 787.449431] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.449768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.449883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.450190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.450309] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.451457] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.451635] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.451746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.451975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.452175] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.452304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.452389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.452561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.452673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.452802] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.454138] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc66dfb-cd12-45a4-85b4-45ea26512170 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.454280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc66dfb-cd12-45a4-85b4-45ea26512170" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.454370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc66dfb-cd12-45a4-85b4-45ea26512170" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.454551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc66dfb-cd12-45a4-85b4-45ea26512170" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.454944] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc66dfb-cd12-45a4-85b4-45ea26512170',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.957028] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.957865] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.957974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.962019] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fc66dfb-cd12-45a4-85b4-45ea26512170 with status ACTIVE [ 787.962019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.962019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.962019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.962019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.962019] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fc66dfb-cd12-45a4-85b4-45ea26512170 is going to be updated. [ 787.980099] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.980323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.980323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.980530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.980656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.980803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc66dfb-cd12-45a4-85b4-45ea26512170" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.460143] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.896239] env[69358]: INFO networking_nsxv3.common.synchronization [None req-e68ba720-8c60-48a7-b604-f3573990ded9 None None] Enqueued Resource ID: 5611151c-b4c2-4ed8-9f47-55e747db0835 with Priority: HIGHEST for action port [ 788.897063] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5611151c-b4c2-4ed8-9f47-55e747db0835 with Priority: HIGHEST for action port [ 788.897732] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5611151c-b4c2-4ed8-9f47-55e747db0835 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.897732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5611151c-b4c2-4ed8-9f47-55e747db0835" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.897732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5611151c-b4c2-4ed8-9f47-55e747db0835" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.898358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5611151c-b4c2-4ed8-9f47-55e747db0835" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.898358] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5611151c-b4c2-4ed8-9f47-55e747db0835',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.961964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.962477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.962477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.962477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.962477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.962595] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be created. [ 788.987064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.987064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.987064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.987064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.987255] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.996664] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: UNINITIALIZED for 2s [ 789.154236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d18a7451-b9c3-48be-82ef-e20729d3779a in Status: SUCCESS [ 789.154236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.400317] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5611151c-b4c2-4ed8-9f47-55e747db0835 [ 789.400923] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.400923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.400923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.401528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.401528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.401528] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5611151c-b4c2-4ed8-9f47-55e747db0835 already deleted. [ 789.401528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5611151c-b4c2-4ed8-9f47-55e747db0835" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.003848] env[69358]: INFO networking_nsxv3.common.synchronization [req-b6a8a0e9-5620-458d-afab-95769ae04fce req-6d22983e-f8f1-43f7-b040-3dd5ab6da17e tempest-VolumesAssistedSnapshotsTest-737708639 tempest-VolumesAssistedSnapshotsTest-737708639-project-member] Enqueued Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_members [ 790.007981] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGHEST for action security_group_members [ 790.007981] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3790264b-87dd-4660-b7c5-8d4dc98f1500 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.007981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.007981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.007981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.007981] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.007981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.007981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.007981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.007981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.007981] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.509826] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.510010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.510483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.510483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.510483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.510588] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.510698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.510733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.510862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.510934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.511049] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 is going to be updated. [ 790.536845] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.537043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.537115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.537343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.537479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.545191] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 in Status: IN_PROGRESS for 2s [ 791.006304] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 791.006304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.006304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.006714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.006714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.006842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.007077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.007292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.007380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.007477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.007589] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.512891] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.513123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.513203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.513445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.513652] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.513754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.513828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.513987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.514095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.514205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.514383] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.514479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.514535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.514692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.514839] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.514940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.514995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.515164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.515239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.515322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.515479] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.770613] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ef885795-263d-493a-91fc-b8e6fa8b16f8 None None] Enqueued Resource ID: b468b488-ee68-479f-b1ba-a24956a69f8f with Priority: HIGHEST for action port [ 791.771475] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b468b488-ee68-479f-b1ba-a24956a69f8f with Priority: HIGHEST for action port [ 791.771696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b468b488-ee68-479f-b1ba-a24956a69f8f taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.771961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b468b488-ee68-479f-b1ba-a24956a69f8f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.777202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b468b488-ee68-479f-b1ba-a24956a69f8f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.777619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b468b488-ee68-479f-b1ba-a24956a69f8f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.777716] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b468b488-ee68-479f-b1ba-a24956a69f8f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.021132] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d904f37a-b3f7-4aef-9721-265081cb343b: rpc.has_security_group_logging(os_id): False [ 792.047363] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.047851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.047851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.047851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.047958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.048888] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.048888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.048888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.048888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.048888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.048888] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.049475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.049475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.049475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.049475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.049638] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.049772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.049772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.050248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.050248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.050248] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be created. [ 792.133490] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.133652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.133698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.133914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.134180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.153174] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 792.280490] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b468b488-ee68-479f-b1ba-a24956a69f8f [ 792.280701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.280888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.280965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.281220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.281315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.282060] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b468b488-ee68-479f-b1ba-a24956a69f8f already deleted. [ 792.282060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b468b488-ee68-479f-b1ba-a24956a69f8f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.556104] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 in Status: SUCCESS [ 792.556104] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 deletion is rescheduled due to dependency. [ 792.556104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.802562] env[69358]: INFO networking_nsxv3.common.synchronization [req-f49d938e-607f-4b67-91ea-242b2f7e4cf1 req-e89d0a47-d027-4ca6-b323-44ec57cf11b8 tempest-ServerExternalEventsTest-1185170337 tempest-ServerExternalEventsTest-1185170337-project-member] Enqueued Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGHEST for action security_group_members [ 793.803317] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGHEST for action security_group_members [ 793.803436] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18a7451-b9c3-48be-82ef-e20729d3779a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.804024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.804024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.804024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.804024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.804218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.804251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.804662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.804662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.804662] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.164791] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 794.165036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.306844] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.307036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.307114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.307753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.307857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.308083] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.308210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.308239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.308400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.308477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.308564] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18a7451-b9c3-48be-82ef-e20729d3779a is going to be updated. [ 794.340198] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.340268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.340341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.341493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.341493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.348882] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18a7451-b9c3-48be-82ef-e20729d3779a in Status: IN_PROGRESS for 2s [ 796.098128] env[69358]: INFO networking_nsxv3.common.synchronization [req-e0240e8c-d8db-43c9-9341-c6302812ace1 req-3571bdb7-e1d1-4b28-a5de-13326bda5056 tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 796.098128] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 796.098128] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.098128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.098665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.101325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.101325] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.101325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.101325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.101325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.101325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.101325] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.362862] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18a7451-b9c3-48be-82ef-e20729d3779a in Status: SUCCESS [ 796.363129] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18a7451-b9c3-48be-82ef-e20729d3779a deletion is rescheduled due to dependency. [ 796.366201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.564491] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.565196] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.565566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.567747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.567747] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.567747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.567747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.567747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.567747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.567747] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.568505] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.568650] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.568772] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.568892] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.569010] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.569150] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.587694] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.587846] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.588016] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.588223] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.588779] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e58916e8-062c-4277-89fa-8c407930d32b taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.589016] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e58916e8-062c-4277-89fa-8c407930d32b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.589162] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e58916e8-062c-4277-89fa-8c407930d32b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.589494] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e58916e8-062c-4277-89fa-8c407930d32b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.589642] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58916e8-062c-4277-89fa-8c407930d32b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.601912] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.601992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.602097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.602290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.602397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.602627] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.603122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.603277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.603462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.603549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.603653] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 796.629177] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.629177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.629177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.629177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.629177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.635785] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 797.098542] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.098817] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.098891] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.099203] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.099356] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.099509] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e58916e8-062c-4277-89fa-8c407930d32b not found, creating... [ 797.099763] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.100031] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.100158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.100381] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.100522] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.100801] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.100955] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.101087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.101296] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.101429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.101568] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e58916e8-062c-4277-89fa-8c407930d32b is going to be created. [ 797.121273] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.121464] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.121589] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.121841] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.122131] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.122350] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e58916e8-062c-4277-89fa-8c407930d32b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.914178] env[69358]: INFO networking_nsxv3.common.synchronization [req-e0240e8c-d8db-43c9-9341-c6302812ace1 req-b77155bb-17a7-41ec-ade7-199fac1550d5 service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 797.914178] env[69358]: INFO networking_nsxv3.common.synchronization [req-e0240e8c-d8db-43c9-9341-c6302812ace1 req-b77155bb-17a7-41ec-ade7-199fac1550d5 service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 797.914178] env[69358]: INFO networking_nsxv3.common.synchronization [req-e0240e8c-d8db-43c9-9341-c6302812ace1 req-b77155bb-17a7-41ec-ade7-199fac1550d5 service nova] Enqueued Resource ID: e58916e8-062c-4277-89fa-8c407930d32b with Priority: HIGHEST for action port [ 797.918318] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 797.918318] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 797.918318] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58916e8-062c-4277-89fa-8c407930d32b with Priority: HIGHEST for action port [ 797.918318] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.918318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.918318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.918318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.918318] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.918318] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.918318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.918318] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e58916e8-062c-4277-89fa-8c407930d32b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.918318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e58916e8-062c-4277-89fa-8c407930d32b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.918318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e58916e8-062c-4277-89fa-8c407930d32b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.921185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e58916e8-062c-4277-89fa-8c407930d32b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.921363] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58916e8-062c-4277-89fa-8c407930d32b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.215446] env[69358]: INFO networking_nsxv3.common.synchronization [None req-10eb5cc6-2026-4d38-95b1-6d5246763a6f None None] Enqueued Resource ID: 308a564e-c146-4566-941c-63561a4bd1c3 with Priority: HIGHEST for action port [ 798.215741] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 308a564e-c146-4566-941c-63561a4bd1c3 with Priority: HIGHEST for action port [ 798.216361] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-308a564e-c146-4566-941c-63561a4bd1c3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.216502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-308a564e-c146-4566-941c-63561a4bd1c3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.216631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-308a564e-c146-4566-941c-63561a4bd1c3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.216858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-308a564e-c146-4566-941c-63561a4bd1c3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.216947] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('308a564e-c146-4566-941c-63561a4bd1c3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.424249] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.424249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.429073] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e58916e8-062c-4277-89fa-8c407930d32b with status ACTIVE [ 798.429073] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.429073] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.429073] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.429073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.429073] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e58916e8-062c-4277-89fa-8c407930d32b is going to be updated. [ 798.459127] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.459127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.459127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.459127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.459127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.459127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e58916e8-062c-4277-89fa-8c407930d32b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.648048] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 798.649542] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 deletion is rescheduled due to dependency. [ 798.649542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.649542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.649542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.649542] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.649542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.649542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.649542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.649542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.650078] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.723280] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 308a564e-c146-4566-941c-63561a4bd1c3 [ 798.723280] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.723280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.723280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.723280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.723565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.723565] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:308a564e-c146-4566-941c-63561a4bd1c3 already deleted. [ 798.723565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-308a564e-c146-4566-941c-63561a4bd1c3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.154841] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.622902] env[69358]: INFO networking_nsxv3.common.synchronization [req-8d5e35bb-8a96-4ed0-9fbb-b192a2626dcf req-2eeae204-73ee-4b0d-b44f-6bbb45421902 tempest-ImagesOneServerTestJSON-2017661083 tempest-ImagesOneServerTestJSON-2017661083-project-member] Enqueued Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGHEST for action security_group_members [ 799.623503] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGHEST for action security_group_members [ 799.623802] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.623921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.624009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.626088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.626260] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.626368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.626431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.626578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.626662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.626755] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.661952] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.129346] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.129527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.129599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.129811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.129894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.130102] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.130191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.130249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.130387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.130459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.130539] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a is going to be updated. [ 800.159640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.160272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.160272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.160272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.160424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.163236] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.163443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.163577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.163787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.163904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.164034] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 800.170077] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a in Status: IN_PROGRESS for 2s [ 800.188303] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.188477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.188545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.188728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.188856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.201632] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 800.292998] env[69358]: INFO networking_nsxv3.common.synchronization [None req-e8208f9d-327f-4bec-a62f-a5e773dddb61 None None] Enqueued Resource ID: 526596d2-2a79-4a27-ac7a-c98cfb0737bb with Priority: HIGHEST for action port [ 800.293749] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 526596d2-2a79-4a27-ac7a-c98cfb0737bb with Priority: HIGHEST for action port [ 800.294398] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-526596d2-2a79-4a27-ac7a-c98cfb0737bb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.299308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-526596d2-2a79-4a27-ac7a-c98cfb0737bb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.299308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-526596d2-2a79-4a27-ac7a-c98cfb0737bb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.299308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-526596d2-2a79-4a27-ac7a-c98cfb0737bb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.299308] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('526596d2-2a79-4a27-ac7a-c98cfb0737bb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.802032] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 526596d2-2a79-4a27-ac7a-c98cfb0737bb [ 800.802032] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.802032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.802032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.802032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.802032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.802032] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:526596d2-2a79-4a27-ac7a-c98cfb0737bb already deleted. [ 800.802032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-526596d2-2a79-4a27-ac7a-c98cfb0737bb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.245405] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c4d043f-06e8-4375-b64e-99e09072c121 req-ecb09a31-8c09-4c34-9f2b-0ffe30015ecd tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 801.246391] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 801.246463] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.246599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.246975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.246975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.247532] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.247663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.247745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.247918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.248016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.248172] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.345705] env[69358]: INFO networking_nsxv3.common.synchronization [req-a278c6a3-9071-43b7-8436-33821d96ccc7 req-391d3eea-c83f-45e9-b412-6b0b8d9a1c3f tempest-ListServerFiltersTestJSON-1173311410 tempest-ListServerFiltersTestJSON-1173311410-project-member] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 801.346353] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 801.346727] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.346912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.346983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.347246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.347565] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.347634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.347710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.347893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.348039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.348449] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.696948] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.696948] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.696948] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.696948] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.696948] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.697193] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.697229] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.697470] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.697617] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.698141] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.698266] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.698375] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.698545] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.698709] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.698825] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.698973] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.716396] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.716556] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.717414] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.717414] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.717414] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-f023788a-9f97-406f-9d31-6e852f2e3277 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.717414] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-f023788a-9f97-406f-9d31-6e852f2e3277" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.717661] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-f023788a-9f97-406f-9d31-6e852f2e3277" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.717901] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-f023788a-9f97-406f-9d31-6e852f2e3277" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.717964] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f023788a-9f97-406f-9d31-6e852f2e3277',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.750557] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.854121] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.186071] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a in Status: SUCCESS [ 802.186071] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a deletion is rescheduled due to dependency. [ 802.186071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.211324] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 802.211500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.211662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.211880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.212112] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.213045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.213045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.213045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.213045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.213045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.213045] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.220840] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.220977] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.221096] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.221346] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.221482] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.221633] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port f023788a-9f97-406f-9d31-6e852f2e3277 not found, creating... [ 802.221887] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.222074] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.222208] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.222426] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.222560] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.222873] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.222988] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.223199] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.223592] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.223592] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.223733] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: f023788a-9f97-406f-9d31-6e852f2e3277 is going to be created. [ 802.250776] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.250971] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.251105] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.251365] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.251579] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.251817] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-f023788a-9f97-406f-9d31-6e852f2e3277" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.254175] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.356377] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.715769] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.715769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.715769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.715769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.715769] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.715769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.715769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.715769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.715769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.716137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.716137] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.716137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.716137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.716267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.716374] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.716466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.716525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.716660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.716735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.716815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.716906] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.756203] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.756332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.756410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.756621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.756693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.756849] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 802.782921] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.783111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.783203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.783424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.783574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.792153] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 802.858357] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.858730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.858730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.858809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.858875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.858972] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 802.885518] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.885669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.885741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.885963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.886135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.895223] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 803.013726] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c4d043f-06e8-4375-b64e-99e09072c121 req-23529a96-2c57-4ec4-b633-e18ca018439f service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 803.013726] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c4d043f-06e8-4375-b64e-99e09072c121 req-23529a96-2c57-4ec4-b633-e18ca018439f service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 803.013726] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c4d043f-06e8-4375-b64e-99e09072c121 req-23529a96-2c57-4ec4-b633-e18ca018439f service nova] Enqueued Resource ID: f023788a-9f97-406f-9d31-6e852f2e3277 with Priority: HIGHEST for action port [ 803.014135] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 803.014832] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 803.015093] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f023788a-9f97-406f-9d31-6e852f2e3277 with Priority: HIGHEST for action port [ 803.015477] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.015736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.020020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.020020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.020020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.020020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.020020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.020480] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-f023788a-9f97-406f-9d31-6e852f2e3277 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.021058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f023788a-9f97-406f-9d31-6e852f2e3277" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.021216] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f023788a-9f97-406f-9d31-6e852f2e3277" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.021505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f023788a-9f97-406f-9d31-6e852f2e3277" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.022586] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f023788a-9f97-406f-9d31-6e852f2e3277',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.219232] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e45a41dd-b21d-4639-af89-ce7883a3d987: rpc.has_security_group_logging(os_id): False [ 803.240045] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.240045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.240045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.240045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.240045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.240293] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.240293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.240376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.240486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.240564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.240832] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.240956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.241028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.241175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.241249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.241447] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.241540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.241603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.241785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.241882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.241970] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 803.300990] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.301147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.301224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.301426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.301568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.313560] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 803.524347] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.524347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.526315] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f023788a-9f97-406f-9d31-6e852f2e3277 with status ACTIVE [ 803.526724] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.526724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.526724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.526906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.526996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.528111] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.528111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.528111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.528111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.528111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.528111] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.528111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.528111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.528111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.528111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.528427] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f023788a-9f97-406f-9d31-6e852f2e3277 is going to be updated. [ 803.547576] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.547720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.547786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.548221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.548221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.548366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f023788a-9f97-406f-9d31-6e852f2e3277" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.824478] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 804.824478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.824478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.824975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.824975] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.824975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.824975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.825135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.825237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.825393] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.905500] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 804.906099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.326023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 805.326121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.329447] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.831179] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.334081] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.334081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.334081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.334319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.334319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.334410] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 806.375531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.376161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.376269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.376503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.376712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.386153] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 808.016452] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 808.016761] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 808.400018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 808.401212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.401406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.401630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.401827] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.401947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.402081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.402347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.402414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.402579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.402579] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.907131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.907131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.907131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.907131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.907131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.907718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.907718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.907718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.907718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.907718] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.409652] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 809.428442] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.428632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.428681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.428900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.428999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.429202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.429311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.429370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.429528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.429608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.429797] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.429879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.429936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.430089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.430470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.430470] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.430470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.430686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.430686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.430742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.430777] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 809.494180] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.494339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.494394] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.494703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.494853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.508262] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 811.522828] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 811.523123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.029369] env[69358]: INFO networking_nsxv3.common.synchronization [req-fcc7a61c-cd86-4c9d-b9ad-95fa0f21b5e9 req-48fd2510-10b1-4269-b0eb-6bb2843d8e1f tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 812.029369] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 812.029656] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.030607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.030607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.030607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.030607] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.030607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.030607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.030607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.030607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.030929] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.534084] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.538019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.538019] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 812.563719] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.563924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.563973] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.564200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.564382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.574985] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 813.233423] env[69358]: INFO networking_nsxv3.common.synchronization [req-84c36891-d7eb-4111-92c8-22fab6129273 req-9bb181c4-45a3-4275-9d67-006256abf983 tempest-ServersNegativeTestMultiTenantJSON-1719448885 tempest-ServersNegativeTestMultiTenantJSON-1719448885-project-member] Enqueued Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGHEST for action security_group_members [ 813.234024] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGHEST for action security_group_members [ 813.234361] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a5293d-e48e-493b-ac38-3a76cc74a5db taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.237845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.237991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.238217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.238410] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.238559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.239338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.239338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.239338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.239338] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.742962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.743895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.744136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.744492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.744642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.745449] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.745680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.745798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.746044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.746174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.746308] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db already deleted. [ 813.746430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.879812] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-933 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.880212] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-933" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.880419] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-933" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.880783] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-933" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.881125] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.881394] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.881569] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.882893] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.883133] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.883446] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.883633] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.883797] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.883952] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.884123] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.884283] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.884428] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.906306] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.906487] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 813.906628] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.906813] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-933" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.907155] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-feaca870-268c-4077-b2c5-46cc29f57bd6 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.907338] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-feaca870-268c-4077-b2c5-46cc29f57bd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.907500] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-feaca870-268c-4077-b2c5-46cc29f57bd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.907818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-feaca870-268c-4077-b2c5-46cc29f57bd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.907982] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feaca870-268c-4077-b2c5-46cc29f57bd6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.412931] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.413465] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.413465] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.414202] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.414202] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.414202] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port feaca870-268c-4077-b2c5-46cc29f57bd6 not found, creating... [ 814.414202] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.414553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.414553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.414980] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.414980] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.415158] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.415732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.415732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.415732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.415732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.415732] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: feaca870-268c-4077-b2c5-46cc29f57bd6 is going to be created. [ 814.443024] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.443024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.443024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.443024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.443024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.443933] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-feaca870-268c-4077-b2c5-46cc29f57bd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.586280] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 814.586280] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 814.586280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.544126] env[69358]: INFO networking_nsxv3.common.synchronization [req-84c36891-d7eb-4111-92c8-22fab6129273 req-a12df5ce-c98c-428b-b5f3-2c3055164373 service nova] Enqueued Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGHEST for action security_group_rules [ 815.544399] env[69358]: INFO networking_nsxv3.common.synchronization [req-84c36891-d7eb-4111-92c8-22fab6129273 req-a12df5ce-c98c-428b-b5f3-2c3055164373 service nova] Enqueued Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGHEST for action security_group_members [ 815.544475] env[69358]: INFO networking_nsxv3.common.synchronization [req-84c36891-d7eb-4111-92c8-22fab6129273 req-a12df5ce-c98c-428b-b5f3-2c3055164373 service nova] Enqueued Resource ID: feaca870-268c-4077-b2c5-46cc29f57bd6 with Priority: HIGHEST for action port [ 815.545140] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGHEST for action security_group_rules [ 815.546569] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGHEST for action security_group_members [ 815.546569] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaca870-268c-4077-b2c5-46cc29f57bd6 with Priority: HIGHEST for action port [ 815.546569] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98a5293d-e48e-493b-ac38-3a76cc74a5db taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.546569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.546569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.546918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.546918] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.547703] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a5293d-e48e-493b-ac38-3a76cc74a5db taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.547833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.547926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.548072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.548254] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.548307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.548348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.548484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.548566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.548651] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.551026] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-feaca870-268c-4077-b2c5-46cc29f57bd6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.551026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feaca870-268c-4077-b2c5-46cc29f57bd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.552077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feaca870-268c-4077-b2c5-46cc29f57bd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.552253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feaca870-268c-4077-b2c5-46cc29f57bd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.552361] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feaca870-268c-4077-b2c5-46cc29f57bd6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.978422] env[69358]: INFO networking_nsxv3.common.synchronization [req-ee2a9f4c-924a-4889-9b88-3322f874f8e0 req-97463cc7-21f7-4d61-bfcd-3f7ba1b33372 tempest-ListServersNegativeTestJSON-1543194324 tempest-ListServersNegativeTestJSON-1543194324-project-member] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 815.979059] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 815.979471] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.979984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.980429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.981370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.981370] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.981370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.981370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.981370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.981370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.981370] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.057020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.057020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a5293d-e48e-493b-ac38-3a76cc74a5db taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.057020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.057020] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port feaca870-268c-4077-b2c5-46cc29f57bd6 with status ACTIVE [ 816.057020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.057020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.057020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.057020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.057020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.057020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.057020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.057020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.059340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.059533] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.060175] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.062601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.062601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.062601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.062601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.062601] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: feaca870-268c-4077-b2c5-46cc29f57bd6 is going to be updated. [ 816.081373] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.081733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.081897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.082183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.082520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.082792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feaca870-268c-4077-b2c5-46cc29f57bd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.288166] env[69358]: INFO networking_nsxv3.common.synchronization [req-e94a3483-5dbb-4b9f-9e5e-7ee68263956e req-6c002140-b84b-4348-8a56-0b2f6727dca2 tempest-ListServersNegativeTestJSON-1543194324 tempest-ListServersNegativeTestJSON-1543194324-project-member] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 816.288166] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGHEST for action security_group_members [ 816.288166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.288166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.485163] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.532859] env[69358]: INFO networking_nsxv3.common.synchronization [req-6994eeab-d138-4db1-8ceb-72174f8f02d3 req-75046857-18d9-47b2-875c-b470b6473c4a tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 816.533155] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 816.533598] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.533598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.533745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.533840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.533997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.534109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.534191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.534311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.534403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.534508] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.556950] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.991700] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.041819] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.060654] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.060801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.060870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.061125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.061217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.061310] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db is going to be created. [ 817.090038] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.090038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.090038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.090038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.090038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.105660] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db in Status: UNINITIALIZED for 2s [ 817.494165] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.494339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.494384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.494610] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.494722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.494813] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 817.519132] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.519297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.519364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.519573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.519745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.529012] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 817.544308] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.046561] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.046985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.046985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.047122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.047122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.047219] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 818.076664] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.076881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.076984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.078700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.078859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.092034] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 818.764652] env[69358]: INFO networking_nsxv3.common.synchronization [req-89be228e-768c-4814-9f55-f52be24cb2b2 req-85ce5cac-5d99-4b1a-98f7-d963e568c63f tempest-FloatingIPsAssociationTestJSON-1066125890 tempest-FloatingIPsAssociationTestJSON-1066125890-project-member] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 818.765454] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 818.765454] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.765634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.765634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.766280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.766280] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.766280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.766280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.766280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.766536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.766536] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.115609] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db in Status: SUCCESS [ 819.118017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.118017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.118017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.118017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.118017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.118017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.118017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.118017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.118017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.118017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.128793] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-241 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.129203] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-241" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.129480] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-241" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.130056] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-241" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.130504] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.130848] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.131072] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.131377] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.132023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.132023] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.132023] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.132245] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.132661] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.134103] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.134103] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.134103] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.151578] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.151759] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.151899] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.152086] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-241" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.152396] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-380bb886-614b-4056-a9d4-3870840d28d7 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.152598] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-380bb886-614b-4056-a9d4-3870840d28d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.153374] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-380bb886-614b-4056-a9d4-3870840d28d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.153520] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-380bb886-614b-4056-a9d4-3870840d28d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.153688] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('380bb886-614b-4056-a9d4-3870840d28d7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.271945] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.537574] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 819.537827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.538019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.538228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.538409] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.538530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.538594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.538735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.538820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.538901] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.625451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a5293d-e48e-493b-ac38-3a76cc74a5db taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.625451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.625451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.625451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.625451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.625451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.625451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.625451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.625451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.625451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.625953] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a5293d-e48e-493b-ac38-3a76cc74a5db taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.625953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.625953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.626091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.626185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.626292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.626359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.626526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.626803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.626803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.626928] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.655590] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.655826] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.655955] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.656258] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.656407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.656566] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 380bb886-614b-4056-a9d4-3870840d28d7 not found, creating... [ 819.656882] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.657132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.657286] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.657512] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.657653] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.657938] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.658261] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.658459] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.658695] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.658904] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.659185] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 380bb886-614b-4056-a9d4-3870840d28d7 is going to be created. [ 819.680551] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.680791] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.680977] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.681340] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.681577] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.681801] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-380bb886-614b-4056-a9d4-3870840d28d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.775573] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.045544] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.045544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.045544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.045544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.045544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.045544] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.045544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.045544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.045544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.045544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.045544] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be updated. [ 820.075740] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.075740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.075740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.075740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.075740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.082869] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: IN_PROGRESS for 2s [ 820.103103] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 820.103335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.128880] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98a5293d-e48e-493b-ac38-3a76cc74a5db: rpc.has_security_group_logging(os_id): False [ 820.146857] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.147091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.147091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.147302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.147391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.147583] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.147688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.147748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.147900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.148047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.148264] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.148361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.148424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.148570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.148658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.148852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.148946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.149017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.149202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.149278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.149367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db is going to be created. [ 820.236747] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.236932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.237016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.237318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.237539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.268498] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db in Status: IN_PROGRESS for 2s [ 820.280297] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.280443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.280443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.280688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.280797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.280879] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e4e649-079d-4cd0-98f4-699005461275 is going to be updated. [ 820.329359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.329661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.329661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.329863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.329979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.339770] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: IN_PROGRESS for 2s [ 820.516374] env[69358]: INFO networking_nsxv3.common.synchronization [req-89be228e-768c-4814-9f55-f52be24cb2b2 req-b66a39db-71b5-42d2-a898-c0cad5c5640e service nova] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_rules [ 820.516557] env[69358]: INFO networking_nsxv3.common.synchronization [req-89be228e-768c-4814-9f55-f52be24cb2b2 req-b66a39db-71b5-42d2-a898-c0cad5c5640e service nova] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 820.516696] env[69358]: INFO networking_nsxv3.common.synchronization [req-89be228e-768c-4814-9f55-f52be24cb2b2 req-b66a39db-71b5-42d2-a898-c0cad5c5640e service nova] Enqueued Resource ID: 380bb886-614b-4056-a9d4-3870840d28d7 with Priority: HIGHEST for action port [ 820.521109] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_rules [ 820.521109] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 820.521109] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380bb886-614b-4056-a9d4-3870840d28d7 with Priority: HIGHEST for action port [ 820.521109] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.521109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.521834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.522123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.522218] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.526298] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.526415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.526747] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-380bb886-614b-4056-a9d4-3870840d28d7 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.526909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-380bb886-614b-4056-a9d4-3870840d28d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.527309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-380bb886-614b-4056-a9d4-3870840d28d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.531026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-380bb886-614b-4056-a9d4-3870840d28d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.531026] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('380bb886-614b-4056-a9d4-3870840d28d7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.702794] env[69358]: INFO networking_nsxv3.common.synchronization [None req-93649df6-60b5-4a7c-b89d-cae28abfc00a None None] Enqueued Resource ID: 9d8e8e5c-b9dd-4177-98b4-bc94638fee43 with Priority: HIGHEST for action port [ 820.703062] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8e8e5c-b9dd-4177-98b4-bc94638fee43 with Priority: HIGHEST for action port [ 820.703652] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d8e8e5c-b9dd-4177-98b4-bc94638fee43 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.703772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d8e8e5c-b9dd-4177-98b4-bc94638fee43" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.703837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d8e8e5c-b9dd-4177-98b4-bc94638fee43" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.704275] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d8e8e5c-b9dd-4177-98b4-bc94638fee43" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.704362] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d8e8e5c-b9dd-4177-98b4-bc94638fee43',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.030549] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.030688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.030890] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 380bb886-614b-4056-a9d4-3870840d28d7 with status ACTIVE [ 821.031073] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.031177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.031248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.031465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.031563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.031751] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.031851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.031911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.032064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.032149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.032356] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.032422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.032471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.032628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.032707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.032791] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 380bb886-614b-4056-a9d4-3870840d28d7 is going to be updated. [ 821.056305] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.056518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.056627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.056889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.057084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.057281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-380bb886-614b-4056-a9d4-3870840d28d7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.208393] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d8e8e5c-b9dd-4177-98b4-bc94638fee43 [ 821.208661] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.208774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.208814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.209040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.209963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.209963] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d8e8e5c-b9dd-4177-98b4-bc94638fee43 already deleted. [ 821.209963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d8e8e5c-b9dd-4177-98b4-bc94638fee43" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.509745] env[69358]: INFO networking_nsxv3.common.synchronization [req-e141c391-35b8-4add-9ac7-c14a64477413 req-9fd267f6-f0af-4983-92ce-a5c45b8682a7 tempest-ImagesOneServerNegativeTestJSON-962105235 tempest-ImagesOneServerNegativeTestJSON-962105235-project-member] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 821.512138] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 821.513135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.513135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.513135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.513135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.513612] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.513865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.515984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.515984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.515984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.515984] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.017505] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.018230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.018230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.018230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.018230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.018459] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.018562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.018622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.022244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.022340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.022438] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 822.049967] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.049967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.049967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.049967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.049967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.056788] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 822.097054] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 in Status: SUCCESS [ 822.097054] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 deletion is rescheduled due to dependency. [ 822.097054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.109791] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.109791] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.111037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.111037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.111333] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.111520] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.111651] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.112599] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.112599] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.112599] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.112599] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.112599] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.112794] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.112794] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.112906] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.113070] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.154034] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.154034] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 822.154034] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.154034] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.154034] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-3897b924-516f-4f89-95c9-3a3df99711f5 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.154034] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-3897b924-516f-4f89-95c9-3a3df99711f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.154034] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-3897b924-516f-4f89-95c9-3a3df99711f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.154034] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-3897b924-516f-4f89-95c9-3a3df99711f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.154034] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3897b924-516f-4f89-95c9-3a3df99711f5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.283236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db in Status: SUCCESS [ 822.283236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.350127] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: SUCCESS [ 822.350514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.350699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.350985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.351263] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.351447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.351533] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.351713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.351803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.351902] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.659040] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.659191] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.659359] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.659704] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.659909] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.660115] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 3897b924-516f-4f89-95c9-3a3df99711f5 not found, creating... [ 822.660456] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.660678] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.660815] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.661090] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.661266] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.661728] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.661792] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.661907] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.662208] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.662391] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.662602] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 3897b924-516f-4f89-95c9-3a3df99711f5 is going to be created. [ 822.686512] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.686794] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.686922] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.687268] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.687524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.687838] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-3897b924-516f-4f89-95c9-3a3df99711f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.857054] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.331107] env[69358]: INFO networking_nsxv3.common.synchronization [None req-1c2f7f16-bdc8-4f9b-9145-10d78ae29a29 None None] Enqueued Resource ID: 9c97bfa5-cb99-4c01-8572-bde6b6e053be with Priority: HIGHEST for action port [ 823.331703] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c97bfa5-cb99-4c01-8572-bde6b6e053be with Priority: HIGHEST for action port [ 823.332069] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c97bfa5-cb99-4c01-8572-bde6b6e053be taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.332334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c97bfa5-cb99-4c01-8572-bde6b6e053be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.332334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c97bfa5-cb99-4c01-8572-bde6b6e053be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.337474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c97bfa5-cb99-4c01-8572-bde6b6e053be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.337474] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c97bfa5-cb99-4c01-8572-bde6b6e053be',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.359402] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.558264] env[69358]: INFO networking_nsxv3.common.synchronization [req-e141c391-35b8-4add-9ac7-c14a64477413 req-514eeafe-8257-44c8-b818-4a257070bbab service nova] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_rules [ 823.558264] env[69358]: INFO networking_nsxv3.common.synchronization [req-e141c391-35b8-4add-9ac7-c14a64477413 req-514eeafe-8257-44c8-b818-4a257070bbab service nova] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 823.558264] env[69358]: INFO networking_nsxv3.common.synchronization [req-e141c391-35b8-4add-9ac7-c14a64477413 req-514eeafe-8257-44c8-b818-4a257070bbab service nova] Enqueued Resource ID: 3897b924-516f-4f89-95c9-3a3df99711f5 with Priority: HIGHEST for action port [ 823.558264] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_rules [ 823.558264] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 823.558264] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3897b924-516f-4f89-95c9-3a3df99711f5 with Priority: HIGHEST for action port [ 823.558264] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.558609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.558609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.558609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.558783] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.561639] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.561803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.561937] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-3897b924-516f-4f89-95c9-3a3df99711f5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.562093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3897b924-516f-4f89-95c9-3a3df99711f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.562183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3897b924-516f-4f89-95c9-3a3df99711f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.562378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3897b924-516f-4f89-95c9-3a3df99711f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.562456] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3897b924-516f-4f89-95c9-3a3df99711f5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.840876] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c97bfa5-cb99-4c01-8572-bde6b6e053be [ 823.840876] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.840876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.840876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.840876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.840876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.840876] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c97bfa5-cb99-4c01-8572-bde6b6e053be already deleted. [ 823.840876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c97bfa5-cb99-4c01-8572-bde6b6e053be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.863445] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.863634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.863714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.863946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.864055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.864156] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e4e649-079d-4cd0-98f4-699005461275 is going to be updated. [ 823.894533] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.895671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.895671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.895671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.895671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.908543] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: IN_PROGRESS for 2s [ 824.068461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.068461] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3897b924-516f-4f89-95c9-3a3df99711f5 with status ACTIVE [ 824.068461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.068461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.068461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.068461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.069072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.069072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.069072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.069072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.069072] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3897b924-516f-4f89-95c9-3a3df99711f5 is going to be updated. [ 824.070668] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 824.070743] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 deletion is rescheduled due to dependency. [ 824.070840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.070963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.071150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.071303] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.071405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.071492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.071658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.071743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.071839] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.090678] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.090871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.090945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.091109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.091242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.091577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3897b924-516f-4f89-95c9-3a3df99711f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.426134] env[69358]: INFO networking_nsxv3.common.synchronization [req-efa008a0-ab71-4a49-b533-483467a5d69d req-142698cb-3c4f-447e-8531-5e8afe670f6a tempest-ServerActionsTestOtherB-1009679498 tempest-ServerActionsTestOtherB-1009679498-project-member] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 824.426134] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 824.426134] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.426134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.426134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.426134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.427874] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.427874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.427874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.427874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.427874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.427874] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.574586] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.930468] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.931397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.931397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.931397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.931397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.931397] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.931397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.931397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.931709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.931709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.931709] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b already deleted. [ 824.931798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.077450] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.306500] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-285 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.306732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.306911] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.307256] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.307495] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.307813] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.307813] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.307976] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.308319] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.308537] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.308652] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.308821] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.308876] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.308974] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.309094] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.309230] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.326873] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.327130] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.327301] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.327483] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.327806] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-967b8d92-dd27-4384-9cfc-581748f09615 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.327984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-967b8d92-dd27-4384-9cfc-581748f09615" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.328116] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-967b8d92-dd27-4384-9cfc-581748f09615" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.328538] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-967b8d92-dd27-4384-9cfc-581748f09615" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.328613] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967b8d92-dd27-4384-9cfc-581748f09615',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.584988] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.585335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.585335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.585519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.585619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.585719] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 825.633648] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.633845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.633946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.634190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.634565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.643059] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 825.832702] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.832961] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.833106] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.833586] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.833746] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.833956] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 967b8d92-dd27-4384-9cfc-581748f09615 not found, creating... [ 825.834460] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.834590] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.834651] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.834881] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.835429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.835429] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.835765] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.835940] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.836109] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.836823] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.836823] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 967b8d92-dd27-4384-9cfc-581748f09615 is going to be created. [ 825.857785] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.858036] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.858195] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.858513] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.858786] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.859511] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-967b8d92-dd27-4384-9cfc-581748f09615" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.921262] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: SUCCESS [ 825.921262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.921262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.921262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.921262] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.921262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.921262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.921262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.921262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.921262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.921262] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.424226] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.424457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.424457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.425548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.425548] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.425548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.425548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.425548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.425548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.425548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.425548] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.425878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.425878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.425878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.425878] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.425989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.426033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.426323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.426323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.426323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.426428] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.931196] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1e4e649-079d-4cd0-98f4-699005461275: rpc.has_security_group_logging(os_id): False [ 826.947500] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.947689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.947746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.947937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.948048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.948267] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.948906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.948906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.948906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.948906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.948906] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.949253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.949253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.949253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.949253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.949429] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.949953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.950479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.950479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.950479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.950479] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1e4e649-079d-4cd0-98f4-699005461275 is going to be updated. [ 827.006238] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.006776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.006776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.006776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.006939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.024028] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: IN_PROGRESS for 2s [ 827.171854] env[69358]: INFO networking_nsxv3.common.synchronization [req-db64fe4c-e590-4036-a8f4-9b7ef06e9816 req-6f414146-374a-4a5a-9955-e0e77f8ee8ce tempest-ServersAdminTestJSON-846589263 tempest-ServersAdminTestJSON-846589263-project-member] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 827.171854] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 827.171854] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.171854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.171854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.171854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.171854] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.171854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.171854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.171854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.171854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.172309] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.330558] env[69358]: INFO networking_nsxv3.common.synchronization [req-efa008a0-ab71-4a49-b533-483467a5d69d req-a7ac1fc7-123b-488b-a2aa-b700f53eefc5 service nova] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 827.331777] env[69358]: INFO networking_nsxv3.common.synchronization [req-efa008a0-ab71-4a49-b533-483467a5d69d req-a7ac1fc7-123b-488b-a2aa-b700f53eefc5 service nova] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 827.331777] env[69358]: INFO networking_nsxv3.common.synchronization [req-efa008a0-ab71-4a49-b533-483467a5d69d req-a7ac1fc7-123b-488b-a2aa-b700f53eefc5 service nova] Enqueued Resource ID: 967b8d92-dd27-4384-9cfc-581748f09615 with Priority: HIGHEST for action port [ 827.331777] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 827.331777] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 827.331777] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 967b8d92-dd27-4384-9cfc-581748f09615 with Priority: HIGHEST for action port [ 827.332444] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.333028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.333157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.333427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.333630] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.334652] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.334652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.334742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.338020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.338020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.338020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.338020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.338020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.338020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.338020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.338020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-967b8d92-dd27-4384-9cfc-581748f09615 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.338020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-967b8d92-dd27-4384-9cfc-581748f09615" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.338020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-967b8d92-dd27-4384-9cfc-581748f09615" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.338020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-967b8d92-dd27-4384-9cfc-581748f09615" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.338020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967b8d92-dd27-4384-9cfc-581748f09615',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.656238] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 827.656238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.656238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.656238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.656238] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.656238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.656238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.656238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.656238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.656238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.656238] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.675254] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.839483] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.842962] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.842962] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 967b8d92-dd27-4384-9cfc-581748f09615 with status ACTIVE [ 827.842962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.842962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.842962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.842962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.843596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.843596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.843596] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 967b8d92-dd27-4384-9cfc-581748f09615 is going to be updated. [ 827.861316] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.861454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.861563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.861736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.862153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.862153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-967b8d92-dd27-4384-9cfc-581748f09615" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.879412] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.879669] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.879812] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.880105] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.880370] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.880539] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.880658] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.880962] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.882101] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.882101] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.882216] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.882249] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.882355] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.882469] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.882577] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.882738] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.900554] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.900749] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.900893] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.901087] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-898" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.901397] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-baad3547-d2f1-4cef-8209-71257f36e626 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.901568] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-baad3547-d2f1-4cef-8209-71257f36e626" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.901691] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-baad3547-d2f1-4cef-8209-71257f36e626" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.902030] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-baad3547-d2f1-4cef-8209-71257f36e626" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.902174] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baad3547-d2f1-4cef-8209-71257f36e626',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.160397] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.160989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.160989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.161231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.161434] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.161550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.161610] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.161801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.161937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.162014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.162150] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.162242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.162305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.162446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.162582] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.162850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.162850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.162978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.163521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.163829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.164257] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.179411] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.344642] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.407615] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.407870] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.408089] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.408346] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.408507] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.408713] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port baad3547-d2f1-4cef-8209-71257f36e626 not found, creating... [ 828.408971] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.409184] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.409291] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.409533] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.409680] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.409986] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.413142] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.413142] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.413142] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.413142] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.413142] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: baad3547-d2f1-4cef-8209-71257f36e626 is going to be created. [ 828.435407] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.435523] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.435584] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.435861] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.436114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.436343] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-baad3547-d2f1-4cef-8209-71257f36e626" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.591908] env[69358]: INFO networking_nsxv3.common.synchronization [None req-b5008e22-f9da-4629-b456-3021ef812fa1 None None] Enqueued Resource ID: 7bd21080-f6d1-4c61-97b9-bf773cd4e7d6 with Priority: HIGHEST for action port [ 828.592190] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bd21080-f6d1-4c61-97b9-bf773cd4e7d6 with Priority: HIGHEST for action port [ 828.592788] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bd21080-f6d1-4c61-97b9-bf773cd4e7d6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.592998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bd21080-f6d1-4c61-97b9-bf773cd4e7d6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.592998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bd21080-f6d1-4c61-97b9-bf773cd4e7d6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.593266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bd21080-f6d1-4c61-97b9-bf773cd4e7d6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.593352] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd21080-f6d1-4c61-97b9-bf773cd4e7d6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.670368] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b755d42e-d250-4f75-9179-3ef054a079c6: rpc.has_security_group_logging(os_id): False [ 828.686022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.686227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.686279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.686462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.686559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.686745] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 828.688801] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.689086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.689086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.689477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.689569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.691715] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.691715] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.691715] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.691715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.692260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.692260] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 828.725221] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.725366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.725441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.725651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.725794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.733807] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 828.753388] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.753519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.753586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.753809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.753946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.764118] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 828.846783] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.846955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.847170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.847264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.847357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.847455] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be created. [ 828.868733] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.868881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.868954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.869176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.869335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.877490] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: UNINITIALIZED for 2s [ 829.037737] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: SUCCESS [ 829.038028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.096602] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bd21080-f6d1-4c61-97b9-bf773cd4e7d6 [ 829.097095] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.097095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.097095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.097322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.097524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.097524] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bd21080-f6d1-4c61-97b9-bf773cd4e7d6 already deleted. [ 829.097621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bd21080-f6d1-4c61-97b9-bf773cd4e7d6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.490306] env[69358]: INFO networking_nsxv3.common.synchronization [req-db64fe4c-e590-4036-a8f4-9b7ef06e9816 req-f2ea3969-64fe-4b73-bd6e-4c31e445dfe7 service nova] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_rules [ 829.490545] env[69358]: INFO networking_nsxv3.common.synchronization [req-db64fe4c-e590-4036-a8f4-9b7ef06e9816 req-f2ea3969-64fe-4b73-bd6e-4c31e445dfe7 service nova] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 829.492129] env[69358]: INFO networking_nsxv3.common.synchronization [req-db64fe4c-e590-4036-a8f4-9b7ef06e9816 req-f2ea3969-64fe-4b73-bd6e-4c31e445dfe7 service nova] Enqueued Resource ID: baad3547-d2f1-4cef-8209-71257f36e626 with Priority: HIGHEST for action port [ 829.492129] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_rules [ 829.492129] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 829.492129] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baad3547-d2f1-4cef-8209-71257f36e626 with Priority: HIGHEST for action port [ 829.492129] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.492595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.492595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.492595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.492595] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.494567] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.494791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.495149] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-baad3547-d2f1-4cef-8209-71257f36e626 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.495403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baad3547-d2f1-4cef-8209-71257f36e626" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.495565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baad3547-d2f1-4cef-8209-71257f36e626" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.495892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baad3547-d2f1-4cef-8209-71257f36e626" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.496066] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baad3547-d2f1-4cef-8209-71257f36e626',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.995705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.995705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.000503] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port baad3547-d2f1-4cef-8209-71257f36e626 with status ACTIVE [ 830.000964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.001307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.001499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.001842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.004018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.004018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.004018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.004018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: baad3547-d2f1-4cef-8209-71257f36e626 is going to be updated. [ 830.026694] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.026694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.026694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.026694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.026694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.026694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baad3547-d2f1-4cef-8209-71257f36e626" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.493068] env[69358]: INFO networking_nsxv3.common.synchronization [req-2ca3b3a8-3039-4e88-8a2c-26b37b2c0158 req-ebedfaca-5fb3-4185-8a7d-9f0641d948fa tempest-ServersNegativeTestMultiTenantJSON-1719448885 tempest-ServersNegativeTestMultiTenantJSON-1719448885-project-member] Enqueued Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGHEST for action security_group_members [ 830.494486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGHEST for action security_group_members [ 830.495747] env[69358]: INFO networking_nsxv3.common.synchronization [req-0a6ca7b3-6f50-4bdc-b577-cc6068720087 req-8e99f504-2a0e-4826-bf31-142eb8425895 tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 830.496908] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a5293d-e48e-493b-ac38-3a76cc74a5db taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.496908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.497276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.497276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.497359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.497463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.497595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.497707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.497998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.497998] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.501093] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 830.501093] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.501265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.501265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.501356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.501499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.501589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.501647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.501780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.502327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.502327] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.542036] env[69358]: INFO networking_nsxv3.common.synchronization [None req-4043a1b2-0ca0-4080-b0b1-1c2379e8301c None None] Enqueued Resource ID: f95d24fc-6500-474f-8017-b7e1eb82d1fb with Priority: HIGHEST for action port [ 830.542838] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f95d24fc-6500-474f-8017-b7e1eb82d1fb with Priority: HIGHEST for action port [ 830.542884] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-f95d24fc-6500-474f-8017-b7e1eb82d1fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.542967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f95d24fc-6500-474f-8017-b7e1eb82d1fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.543044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f95d24fc-6500-474f-8017-b7e1eb82d1fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.543397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f95d24fc-6500-474f-8017-b7e1eb82d1fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.543480] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f95d24fc-6500-474f-8017-b7e1eb82d1fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.581904] env[69358]: INFO networking_nsxv3.common.synchronization [req-6ad53b51-3603-4caf-b05f-69c1d3e22b0f req-0d9ff8b4-ab85-4d75-b699-20ca09acdfb7 tempest-ServersTestFqdnHostnames-758146594 tempest-ServersTestFqdnHostnames-758146594-project-member] Enqueued Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_members [ 830.582403] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_members [ 830.582722] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4d32ff-0296-4f24-a97d-f033779cef5a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.582852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.582913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.583325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.583493] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.583592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.583651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.583810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.583897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.583988] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.744014] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 830.744239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.744409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.744630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.744821] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.744961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.744999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.745157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.745241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.745344] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.775920] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 830.775920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.888173] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 830.891020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.891020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.891020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.891020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.891020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.891020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.891020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.891020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.891020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.891020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.938285] env[69358]: INFO networking_nsxv3.common.synchronization [None req-8106a82b-852e-4c2f-8afe-9017c93cf2c4 tempest-ServersTestBootFromVolume-1590001012 tempest-ServersTestBootFromVolume-1590001012-project-member] Enqueued Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_rules [ 830.938753] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_rules [ 830.939100] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca6990b0-078a-4815-9003-99ea585a4222 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.939296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.939379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.939920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.939920] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.003624] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.003704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.003742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.004038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.004127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.004269] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.004397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.004502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.006529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.006650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.006650] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db is going to be updated. [ 831.008481] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.009032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.009032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.009142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.009316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.009510] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.011056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.011056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.011056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.011056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.011056] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 831.034666] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.036334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.036334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.036334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.036334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.038146] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.038146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.038146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.038325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.038486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.047837] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 831.048301] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db in Status: IN_PROGRESS for 2s [ 831.048443] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f95d24fc-6500-474f-8017-b7e1eb82d1fb [ 831.049220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.049220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.049220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.049220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.049220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.049545] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f95d24fc-6500-474f-8017-b7e1eb82d1fb already deleted. [ 831.049545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f95d24fc-6500-474f-8017-b7e1eb82d1fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.073402] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.073915] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.074165] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.074975] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.075351] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.080018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.080018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.080018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.080018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.080018] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.080018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.080018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.080018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.080018] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.080018] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.080018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.087177] env[69358]: INFO networking_nsxv3.common.synchronization [None req-679c44a2-1e08-4ef1-b4c8-0105f0621d07 tempest-ServersTestBootFromVolume-1590001012 tempest-ServersTestBootFromVolume-1590001012-project-member] Enqueued Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_rules [ 831.087982] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.089699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.091846] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.091846] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4d32ff-0296-4f24-a97d-f033779cef5a already deleted. [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.091846] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_rules [ 831.091846] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca6990b0-078a-4815-9003-99ea585a4222 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.091846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.096820] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.097152] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.097454] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.098132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.099890] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.099890] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.099890] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.100183] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.100183] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7caead-72ff-40ee-9e2d-cd39ad02bb77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.248436] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.396022] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.466288] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.466507] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.466507] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.466877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.466877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.466981] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca6990b0-078a-4815-9003-99ea585a4222 already deleted. [ 831.466981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.467200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.467306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.467391] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.602592] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.602916] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.603037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.603321] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.603472] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.603631] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 1e7caead-72ff-40ee-9e2d-cd39ad02bb77 not found, creating... [ 831.603895] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.604096] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.604221] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.604435] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.604572] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.604853] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.605098] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.605332] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.605567] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.605713] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.605859] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 1e7caead-72ff-40ee-9e2d-cd39ad02bb77 is going to be created. [ 831.626173] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.626373] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.626661] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.626743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.627057] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.627285] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.751490] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.898427] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0f3175f-70d6-4954-936f-524f7ca25a4b: rpc.has_security_group_logging(os_id): False [ 831.917412] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.917575] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.917618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.917834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.917930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.918251] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.918320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.918356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.918509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.918577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.918663] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be created. [ 831.975992] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.976186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.976282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.976503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.976698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.992701] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 831.997566] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.997566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.997566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.997566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.997566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.997566] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca6990b0-078a-4815-9003-99ea585a4222 already deleted. [ 831.997566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.254594] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.254822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.254860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.255161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.255296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.255399] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 832.292181] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.292335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.292402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.292617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.292792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.302345] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 832.532338] env[69358]: INFO networking_nsxv3.common.synchronization [req-6ad53b51-3603-4caf-b05f-69c1d3e22b0f req-fa1a366f-033c-4e2d-ac0e-e12782f2784c service nova] Enqueued Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_rules [ 832.533306] env[69358]: INFO networking_nsxv3.common.synchronization [req-6ad53b51-3603-4caf-b05f-69c1d3e22b0f req-fa1a366f-033c-4e2d-ac0e-e12782f2784c service nova] Enqueued Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_members [ 832.533306] env[69358]: INFO networking_nsxv3.common.synchronization [req-6ad53b51-3603-4caf-b05f-69c1d3e22b0f req-fa1a366f-033c-4e2d-ac0e-e12782f2784c service nova] Enqueued Resource ID: 1e7caead-72ff-40ee-9e2d-cd39ad02bb77 with Priority: HIGHEST for action port [ 832.533306] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_rules [ 832.533306] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_members [ 832.533306] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7caead-72ff-40ee-9e2d-cd39ad02bb77 with Priority: HIGHEST for action port [ 832.533829] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4d32ff-0296-4f24-a97d-f033779cef5a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.533829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.533953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.538274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.538350] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.539240] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4d32ff-0296-4f24-a97d-f033779cef5a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.539354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.539418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.539591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.539730] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.539827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.539889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.540038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.540115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.540207] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.540978] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.541094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.541158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.541298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.541367] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7caead-72ff-40ee-9e2d-cd39ad02bb77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.043306] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.044740] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4d32ff-0296-4f24-a97d-f033779cef5a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.044861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.044996] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e7caead-72ff-40ee-9e2d-cd39ad02bb77 with status ACTIVE [ 833.045164] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.045262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.045322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.045513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.045591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.045747] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.045832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.045888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.046034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.046106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.046271] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.046354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.046410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.046565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.046598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.046672] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e7caead-72ff-40ee-9e2d-cd39ad02bb77 is going to be updated. [ 833.062216] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 833.062394] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 deletion is rescheduled due to dependency. [ 833.062499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.067568] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db in Status: SUCCESS [ 833.067724] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db deletion is rescheduled due to dependency. [ 833.067827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.070854] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.070973] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.071055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.071247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.071412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.071613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e7caead-72ff-40ee-9e2d-cd39ad02bb77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.549587] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.004018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 834.004264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.053724] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.054254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.054254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.054541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.054644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.054712] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4d32ff-0296-4f24-a97d-f033779cef5a is going to be created. [ 834.083020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.083020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.083020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.083020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.083020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.090940] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4d32ff-0296-4f24-a97d-f033779cef5a in Status: UNINITIALIZED for 2s [ 834.311945] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 834.312191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.312357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.312673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.312908] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.313049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.313117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.313275] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.313526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.313526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.313526] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.816638] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.816725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.816802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.817038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.817205] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.817311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.817375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.817532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.817618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.817705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.817849] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.817942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.818011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.818279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.818424] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.818699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.818761] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.818904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.818984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.819075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.819165] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.147382] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-7c7370b6-e814-448f-931c-c0cee091b120 tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 835.147382] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 835.147382] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.147382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.147382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.147785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.148307] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.148307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.148307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.148307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.148307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.149433] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.322088] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6825e81-3f64-4e7b-908b-47b35fcde1e2: rpc.has_security_group_logging(os_id): False [ 835.339490] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.340502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.340502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.340502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.340502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.340502] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.340502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.340502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.340865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.340911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.341131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.341237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.341300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.341576] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.341722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.341842] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.341960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.342127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.342416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.342498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.342590] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 835.398078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.398218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.398294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.398510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.398657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.411375] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 835.652450] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.653019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.653122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.653377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.653494] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.653728] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.653856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.653939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.654188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.654291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.654402] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b already deleted. [ 835.654534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.915395] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-d38cfd72-bab4-472e-a33b-46e9da29baf2 tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 835.915957] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 835.916314] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.916437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.916517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.916699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.916852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.916950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.917236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.918860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.919138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.919138] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.100592] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4d32ff-0296-4f24-a97d-f033779cef5a in Status: SUCCESS [ 836.100816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.100977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.101211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.101401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.101519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.101586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.101731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.101819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.101918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.102080] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.237556] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-7c1c6ede-591c-4032-9242-bf107f397993 tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 836.238756] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 836.238756] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.238756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.422805] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.422994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.423187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.423387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.423486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.423693] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.423795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.423930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.424091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.424160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.424290] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b already deleted. [ 836.424347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.424513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.424667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.424820] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.424924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.425035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.425153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.425243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.425366] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.606545] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.746486] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.746784] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-772" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.747015] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-772" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.747533] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-772" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.747901] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.748112] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.748303] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.748566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.748721] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.748989] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.749140] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.749313] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.749448] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.749589] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.749736] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.749916] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.777330] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.777777] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 836.777777] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.778316] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-772" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.778362] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.778553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.778672] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.779198] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.779198] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70ae3bb0-6e0e-43ad-a842-a96b39e2c13a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.931881] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.931881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.931881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.931881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.932372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.932372] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.932372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.932481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.933132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.933132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.933132] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b already deleted. [ 836.933132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.112234] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac4d32ff-0296-4f24-a97d-f033779cef5a: rpc.has_security_group_logging(os_id): False [ 837.129465] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.129566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.129566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.129795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.129978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.130149] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.130280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.130352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.130510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.130589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.130862] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4d32ff-0296-4f24-a97d-f033779cef5a is going to be created. [ 837.190470] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.190470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.190470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.190470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.190470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.211084] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac4d32ff-0296-4f24-a97d-f033779cef5a in Status: IN_PROGRESS for 2s [ 837.282732] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.284390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.284390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.284390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.284390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.284390] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 70ae3bb0-6e0e-43ad-a842-a96b39e2c13a not found, creating... [ 837.284656] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.284927] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.285147] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.285554] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.285801] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.286333] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.286627] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.286879] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.287276] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.287548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.287824] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 70ae3bb0-6e0e-43ad-a842-a96b39e2c13a is going to be created. [ 837.317869] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.317869] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.317869] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.317869] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.317869] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.317869] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.427045] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 837.427299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.341850] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-cf8e6235-6321-454e-832c-42ab0f6b05f7 service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 838.341850] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-cf8e6235-6321-454e-832c-42ab0f6b05f7 service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 838.341850] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-cf8e6235-6321-454e-832c-42ab0f6b05f7 service nova] Enqueued Resource ID: 70ae3bb0-6e0e-43ad-a842-a96b39e2c13a with Priority: HIGHEST for action port [ 838.341850] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 838.342279] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 838.342279] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70ae3bb0-6e0e-43ad-a842-a96b39e2c13a with Priority: HIGHEST for action port [ 838.346219] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.346219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.346219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.346366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.346410] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.347275] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.347372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.347432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.347596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.347732] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.347833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.349148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.354863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.354863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.354863] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.354863] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.354863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.354863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.354863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.354863] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70ae3bb0-6e0e-43ad-a842-a96b39e2c13a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.857144] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.857144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.858379] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.858379] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70ae3bb0-6e0e-43ad-a842-a96b39e2c13a with status ACTIVE [ 838.858479] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.858579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.858650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.858851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.858939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.859129] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.859213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.859299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.859415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.859490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.860156] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.860156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.860156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.860156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.860835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.860955] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70ae3bb0-6e0e-43ad-a842-a96b39e2c13a is going to be updated. [ 838.881826] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.881973] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.882052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.882321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.883093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.883093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70ae3bb0-6e0e-43ad-a842-a96b39e2c13a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.222044] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac4d32ff-0296-4f24-a97d-f033779cef5a in Status: SUCCESS [ 839.222560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.364407] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.763477] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.763884] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-256" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.764233] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-256" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.764475] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-256" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.764745] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.764907] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.765040] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.765287] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.765430] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.765636] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.765789] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.765843] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.765982] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.766117] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.766195] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.766433] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.794914] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.795382] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.795581] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.795778] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-256" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.796220] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-98deaf3e-661b-4e5f-8efd-0a3868f0716e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.796412] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-98deaf3e-661b-4e5f-8efd-0a3868f0716e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.796531] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-98deaf3e-661b-4e5f-8efd-0a3868f0716e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.796865] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-98deaf3e-661b-4e5f-8efd-0a3868f0716e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.797166] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98deaf3e-661b-4e5f-8efd-0a3868f0716e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.866887] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.867075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.867153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.867369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.867460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.867559] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be created. [ 839.892765] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.892931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.893048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.893315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.893482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.903751] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: UNINITIALIZED for 2s [ 840.121709] env[69358]: INFO networking_nsxv3.common.synchronization [None req-9f137846-3415-4973-9f1b-0ebc7af936c2 None None] Enqueued Resource ID: 6e2b1a74-7203-4aea-9aea-2d6094d40a9a with Priority: HIGHEST for action port [ 840.122085] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e2b1a74-7203-4aea-9aea-2d6094d40a9a with Priority: HIGHEST for action port [ 840.122842] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e2b1a74-7203-4aea-9aea-2d6094d40a9a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.123288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e2b1a74-7203-4aea-9aea-2d6094d40a9a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.123288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e2b1a74-7203-4aea-9aea-2d6094d40a9a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.123288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e2b1a74-7203-4aea-9aea-2d6094d40a9a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.123288] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e2b1a74-7203-4aea-9aea-2d6094d40a9a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.304459] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.304813] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.305202] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.305532] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.305692] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.305852] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 98deaf3e-661b-4e5f-8efd-0a3868f0716e not found, creating... [ 840.306205] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.306419] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.306577] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.306873] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.307531] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.308067] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.308306] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.308463] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.308945] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.309187] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.309399] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 98deaf3e-661b-4e5f-8efd-0a3868f0716e is going to be created. [ 840.334246] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.334558] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.335566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.335566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.335566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.335566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-98deaf3e-661b-4e5f-8efd-0a3868f0716e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.626665] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e2b1a74-7203-4aea-9aea-2d6094d40a9a [ 840.626950] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.627062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.627205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.627498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.627498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.627498] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e2b1a74-7203-4aea-9aea-2d6094d40a9a already deleted. [ 840.627813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e2b1a74-7203-4aea-9aea-2d6094d40a9a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.156425] env[69358]: INFO networking_nsxv3.common.synchronization [req-929447e5-9fea-4c6f-a7c6-7760a270c1a8 req-150ecfd9-ff15-4775-b2d5-0b4c5e7e34fb tempest-MigrationsAdminTest-1296336123 tempest-MigrationsAdminTest-1296336123-project-member] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 841.157149] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 841.157520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.157633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.157633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.157815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.157961] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.158581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.158671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.158859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.159957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.159957] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.324313] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-fc53bd85-86cc-4b42-afe1-e4c7bc6c3d2d service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 841.324313] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-fc53bd85-86cc-4b42-afe1-e4c7bc6c3d2d service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 841.324313] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-fc53bd85-86cc-4b42-afe1-e4c7bc6c3d2d service nova] Enqueued Resource ID: 98deaf3e-661b-4e5f-8efd-0a3868f0716e with Priority: HIGHEST for action port [ 841.324313] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 841.324313] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 841.324313] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98deaf3e-661b-4e5f-8efd-0a3868f0716e with Priority: HIGHEST for action port [ 841.324313] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.324313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.324813] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.326097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.326097] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-98deaf3e-661b-4e5f-8efd-0a3868f0716e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.326097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98deaf3e-661b-4e5f-8efd-0a3868f0716e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.326097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98deaf3e-661b-4e5f-8efd-0a3868f0716e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.327731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98deaf3e-661b-4e5f-8efd-0a3868f0716e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.327820] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98deaf3e-661b-4e5f-8efd-0a3868f0716e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.535714] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 841.535850] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:1 started [ 841.607010] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.607010] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.607010] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.607286] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.607541] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.607696] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.607812] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.608456] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.608612] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.608916] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.609094] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.609219] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.609329] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.609442] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.609547] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.609676] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.630013] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.630321] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.630321] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.630454] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.630744] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.630911] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.631042] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.631338] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.631495] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('918ae9db-7ed1-4a9b-a391-0ff02a2081c8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.660761] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.834320] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98deaf3e-661b-4e5f-8efd-0a3868f0716e with status ACTIVE [ 841.834534] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.834665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.834739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.834963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.835083] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.835276] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.835384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.835449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.835573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.835691] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.835824] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.835928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.835998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.836261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.836261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.836261] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98deaf3e-661b-4e5f-8efd-0a3868f0716e is going to be updated. [ 841.855727] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.855913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.855913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.856267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.856267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.856566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98deaf3e-661b-4e5f-8efd-0a3868f0716e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.912496] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 841.912706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.912868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.913181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.913376] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.913479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.913546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.913696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.913779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.913866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.914015] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.914824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.915040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.915337] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.915450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.915517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.916053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.916053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.916053] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.136315] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.137482] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.137482] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.137482] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.137482] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.137482] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 918ae9db-7ed1-4a9b-a391-0ff02a2081c8 not found, creating... [ 842.137726] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.137726] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.137853] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.138094] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.138236] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.138550] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.139567] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.139755] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.139986] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.140144] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.140289] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 918ae9db-7ed1-4a9b-a391-0ff02a2081c8 is going to be created. [ 842.159634] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.159907] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.160075] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.160434] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.160686] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.160911] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.163395] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.257930] env[69358]: INFO networking_nsxv3.common.synchronization [req-abe3373d-a868-4163-a289-1e321208d6cc req-ea5526a5-3928-40ba-9dea-237b5eef9766 tempest-ListServerFiltersTestJSON-1173311410 tempest-ListServerFiltersTestJSON-1173311410-project-member] Enqueued Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 842.258818] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2c3b18-33a0-460a-a199-3124440c68e8 with Priority: HIGHEST for action security_group_members [ 842.259238] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd2c3b18-33a0-460a-a199-3124440c68e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.259521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.259644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.259934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.260176] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.260355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.260448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.260709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.261916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.261916] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd2c3b18-33a0-460a-a199-3124440c68e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.278597] env[69358]: INFO networking_nsxv3.common.synchronization [req-ccec58bc-24bd-4f6f-88c9-5487b3012442 req-3fdfbede-4e97-4b74-bf8d-6d3af3ef37b5 tempest-FloatingIPsAssociationTestJSON-1066125890 tempest-FloatingIPsAssociationTestJSON-1066125890-project-member] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 842.279149] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 842.279893] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.279893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.279893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.282965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.282965] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.282965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.282965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.282965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.282965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.282965] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.417270] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.417562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.417835] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.668022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.668022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.668022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.668543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.668543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.668543] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be updated. [ 842.698349] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.698587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.700235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.700235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.700235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.707969] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: IN_PROGRESS for 2s [ 842.763650] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.764537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.764537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.765675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.765829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.766181] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.766283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.766371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.766559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.766656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.766769] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 is going to be updated. [ 842.785385] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.791357] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.791559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.791559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.792506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.792506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.799929] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: IN_PROGRESS for 2s [ 842.922467] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.936527] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.937262] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-772" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.937262] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-772" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.937262] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-772" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.937498] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.937615] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.937678] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.938074] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.938392] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.938606] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.938812] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.939020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.939182] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.939361] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.939479] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.939640] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.958354] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.958594] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 842.958739] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.958913] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-772" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.959263] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.959424] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.959526] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.959863] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.960019] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1506a0ba-73bc-47b9-837e-f6bd5fecb8aa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.288787] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.305320] env[69358]: INFO networking_nsxv3.common.synchronization [req-929447e5-9fea-4c6f-a7c6-7760a270c1a8 req-3c498c9f-6f3f-4249-bc86-3ddc3d098e5a service nova] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_rules [ 843.306152] env[69358]: INFO networking_nsxv3.common.synchronization [req-929447e5-9fea-4c6f-a7c6-7760a270c1a8 req-3c498c9f-6f3f-4249-bc86-3ddc3d098e5a service nova] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 843.306373] env[69358]: INFO networking_nsxv3.common.synchronization [req-929447e5-9fea-4c6f-a7c6-7760a270c1a8 req-3c498c9f-6f3f-4249-bc86-3ddc3d098e5a service nova] Enqueued Resource ID: 918ae9db-7ed1-4a9b-a391-0ff02a2081c8 with Priority: HIGHEST for action port [ 843.306846] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_rules [ 843.306989] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 843.307093] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918ae9db-7ed1-4a9b-a391-0ff02a2081c8 with Priority: HIGHEST for action port [ 843.307802] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.307931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.307991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.308355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.308441] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.310512] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.310512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.310633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.310704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.310704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.310884] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.311961] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('918ae9db-7ed1-4a9b-a391-0ff02a2081c8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.426581] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.426813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.426813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.427300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.427300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.427300] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 843.438562] env[69358]: INFO networking_nsxv3.common.synchronization [None req-8d47ff81-f76c-496b-a9a8-a93ca16a5c8d None None] Enqueued Resource ID: db2ff597-5365-42c4-adff-710cfb1b6862 with Priority: HIGHEST for action port [ 843.438562] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2ff597-5365-42c4-adff-710cfb1b6862 with Priority: HIGHEST for action port [ 843.438562] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-db2ff597-5365-42c4-adff-710cfb1b6862 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.438562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db2ff597-5365-42c4-adff-710cfb1b6862" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.438562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db2ff597-5365-42c4-adff-710cfb1b6862" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.438562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db2ff597-5365-42c4-adff-710cfb1b6862" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.438562] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db2ff597-5365-42c4-adff-710cfb1b6862',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.454921] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.455120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.455189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.455494] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.455638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.463938] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 843.465535] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.465729] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.465857] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.466140] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.466368] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.466833] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 1506a0ba-73bc-47b9-837e-f6bd5fecb8aa not found, creating... [ 843.467137] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.467303] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.467429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.467868] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.468044] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.468328] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.468750] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.468878] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.469105] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.469245] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.469385] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 1506a0ba-73bc-47b9-837e-f6bd5fecb8aa is going to be created. [ 843.487276] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.487450] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.487551] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.487754] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.487973] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.488211] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.527030] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c0e57858-96cf-4d83-9ec1-d75d436a59f7 None None] Enqueued Resource ID: f4cd7259-78d4-404c-8b21-34d49e49eba6 with Priority: HIGHEST for action port [ 843.527531] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4cd7259-78d4-404c-8b21-34d49e49eba6 with Priority: HIGHEST for action port [ 843.527816] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4cd7259-78d4-404c-8b21-34d49e49eba6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.529026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4cd7259-78d4-404c-8b21-34d49e49eba6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.529026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4cd7259-78d4-404c-8b21-34d49e49eba6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.529026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4cd7259-78d4-404c-8b21-34d49e49eba6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.529026] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4cd7259-78d4-404c-8b21-34d49e49eba6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.794882] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.794882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.794882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.794882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.794882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.794882] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e4e649-079d-4cd0-98f4-699005461275 is going to be updated. [ 843.810686] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.810827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.814553] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 918ae9db-7ed1-4a9b-a391-0ff02a2081c8 with status ACTIVE [ 843.814805] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.814867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.814916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.815133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.815221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.815425] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.815528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.815590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.815737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.815815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.816000] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.816108] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.816171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.816305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.816379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.816462] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 918ae9db-7ed1-4a9b-a391-0ff02a2081c8 is going to be updated. [ 843.819618] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.820890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.820890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.821041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.821160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.834973] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: IN_PROGRESS for 2s [ 843.838754] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.838898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.838959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.839174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.839305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.839458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-918ae9db-7ed1-4a9b-a391-0ff02a2081c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.941067] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db2ff597-5365-42c4-adff-710cfb1b6862 [ 843.941344] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.941485] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.941554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.941821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.941971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.942138] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db2ff597-5365-42c4-adff-710cfb1b6862 already deleted. [ 843.942246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db2ff597-5365-42c4-adff-710cfb1b6862" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.030604] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4cd7259-78d4-404c-8b21-34d49e49eba6 [ 844.030840] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.031029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.031103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.031372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.031418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.031483] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4cd7259-78d4-404c-8b21-34d49e49eba6 already deleted. [ 844.031563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4cd7259-78d4-404c-8b21-34d49e49eba6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.633465] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-70b55ac5-d6d6-496d-b22e-2b4ee50ea994 service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 844.633696] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-70b55ac5-d6d6-496d-b22e-2b4ee50ea994 service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 844.633839] env[69358]: INFO networking_nsxv3.common.synchronization [req-87c13072-2fe0-4be7-bdb4-8639388f9e95 req-70b55ac5-d6d6-496d-b22e-2b4ee50ea994 service nova] Enqueued Resource ID: 1506a0ba-73bc-47b9-837e-f6bd5fecb8aa with Priority: HIGHEST for action port [ 844.635729] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 844.639018] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 844.639018] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1506a0ba-73bc-47b9-837e-f6bd5fecb8aa with Priority: HIGHEST for action port [ 844.639018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.639018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.639018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.639018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.639018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.639018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.639018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.639018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.639018] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1506a0ba-73bc-47b9-837e-f6bd5fecb8aa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.718330] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: SUCCESS [ 844.718330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.718330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.718531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.718640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.718759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.718823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.718969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.719057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.719152] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.809432] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd2c3b18-33a0-460a-a199-3124440c68e8 in Status: SUCCESS [ 844.809432] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd2c3b18-33a0-460a-a199-3124440c68e8 deletion is rescheduled due to dependency. [ 844.809432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd2c3b18-33a0-460a-a199-3124440c68e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.144185] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1506a0ba-73bc-47b9-837e-f6bd5fecb8aa with status ACTIVE [ 845.144185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.144185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.144185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.144185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.144185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.144185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.144185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.144185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.144745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.145018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.145400] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.145689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.145839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.146089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.146263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.147018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1506a0ba-73bc-47b9-837e-f6bd5fecb8aa is going to be updated. [ 845.170803] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.170803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.170803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.170803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.170803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.170803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1506a0ba-73bc-47b9-837e-f6bd5fecb8aa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.221521] env[69358]: INFO networking_nsxv3.common.synchronization [None req-6ccda7cb-76a9-4d9d-901c-d465ef4d3221 tempest-ServerActionsV293TestJSON-324495238 tempest-ServerActionsV293TestJSON-324495238-project-member] Enqueued Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_rules [ 845.221697] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_rules [ 845.221889] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8effc622-7de8-42df-98f1-20eb9e446c1a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.222028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.222109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.222352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.222426] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.227620] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.394761] env[69358]: INFO networking_nsxv3.common.synchronization [None req-651196a5-595a-44e0-bc20-4f9d9ead5f18 tempest-ServerActionsV293TestJSON-324495238 tempest-ServerActionsV293TestJSON-324495238-project-member] Enqueued Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_rules [ 845.395383] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_rules [ 845.395702] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8effc622-7de8-42df-98f1-20eb9e446c1a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.395833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.475465] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 845.475819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.475887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.476116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.476316] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.476427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.476490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.476651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.476982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.476982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.476982] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.477865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.477865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.477865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.477865] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.477865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.477865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.477865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.477865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.478298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.478873] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.479583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.480422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.480422] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.480680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.480768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.481160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.481160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.481160] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.730718] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.748731] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.750027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.750027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.750027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.750027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.750027] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8effc622-7de8-42df-98f1-20eb9e446c1a already deleted. [ 845.750027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.750027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.750027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.750027] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.840052] env[69358]: INFO networking_nsxv3.common.synchronization [None req-9d640880-1fa5-4591-911d-be70b4656bad None None] Enqueued Resource ID: 29137143-9613-49d2-9bb6-1781eb65a16b with Priority: HIGHEST for action port [ 845.840311] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29137143-9613-49d2-9bb6-1781eb65a16b with Priority: HIGHEST for action port [ 845.840862] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-29137143-9613-49d2-9bb6-1781eb65a16b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.841000] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29137143-9613-49d2-9bb6-1781eb65a16b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.841105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29137143-9613-49d2-9bb6-1781eb65a16b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.841348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29137143-9613-49d2-9bb6-1781eb65a16b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.841429] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29137143-9613-49d2-9bb6-1781eb65a16b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.845297] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: SUCCESS [ 845.845634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.941610] env[69358]: INFO networking_nsxv3.common.synchronization [req-2e5ad402-9d9c-4ba9-a860-2e17aceb068b req-62cca21d-91cc-4e22-b974-6585d30accbe tempest-ImagesOneServerNegativeTestJSON-962105235 tempest-ImagesOneServerNegativeTestJSON-962105235-project-member] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 845.945432] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 845.945799] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.945966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.946067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.946230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.946419] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.946536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.946613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.947149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.947149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.947149] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.984512] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55e4213-4f47-44ae-b8e8-d46185e8161b: rpc.has_security_group_logging(os_id): False [ 845.985657] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.005231] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.005374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.005457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.005662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.005753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.005933] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.006042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.006103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.006262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.006341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.006524] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.006618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.006680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.006818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.006892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.007095] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.007190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.007255] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.007403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.007477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.007561] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be created. [ 846.076785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.076980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.076980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.077205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.077510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.087196] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 846.234020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.234377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.234487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.235301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.235301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.235301] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be updated. [ 846.274412] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.274556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.274627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.274833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.274964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.277064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.277186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.277251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.277467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.277594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.277637] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8effc622-7de8-42df-98f1-20eb9e446c1a already deleted. [ 846.277716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.283242] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: IN_PROGRESS for 2s [ 846.344353] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29137143-9613-49d2-9bb6-1781eb65a16b [ 846.344644] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.344806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.344875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.345115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.345213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.345316] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29137143-9613-49d2-9bb6-1781eb65a16b already deleted. [ 846.345426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29137143-9613-49d2-9bb6-1781eb65a16b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.450211] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.450211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.450338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.450486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.450578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.450764] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.450862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.450925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.451089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.451167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.451254] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 846.487722] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.487722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.487722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.487722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.487722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.489480] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.499087] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 846.997555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.997555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.997555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.997555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.997555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.997555] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 847.024732] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.024868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.024970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.025159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.025300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.039175] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 848.101262] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 848.101581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.101662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.101879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.101978] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.292340] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: SUCCESS [ 848.292599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.292775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.292997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.293293] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.293409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.293476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.293636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.293716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.293801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.293893] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.506586] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 848.506586] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 deletion is rescheduled due to dependency. [ 848.506586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.605812] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.606014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.796528] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.796739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.796806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.797733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.797733] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.797733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.797733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.797733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.797733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.798053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.798053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.798053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.798184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.798219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.798359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.798452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.798513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.798669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.799273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.799273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.799273] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.048962] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 849.050064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.053873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.053873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.053873] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.053873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.053873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.053873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.053873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.053873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.053873] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.304027] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38b21152-b672-43d0-bb12-4ff761d0e3a8: rpc.has_security_group_logging(os_id): False [ 849.320515] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.322547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.322547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.322547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.323482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.323672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.323986] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.324306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.324554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.325425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.325425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.325425] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be updated. [ 849.385815] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.386883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.386883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.397276] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: IN_PROGRESS for 2s [ 849.556192] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.556355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.556415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.556629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.556796] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.557091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.557091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.557199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.557199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.557294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.557546] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.557546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.557546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.557836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.557836] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.557998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.557998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.558161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.558161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.558298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.558661] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.060823] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55e4213-4f47-44ae-b8e8-d46185e8161b: rpc.has_security_group_logging(os_id): False [ 850.078329] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.078503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.078585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.078919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.079068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.079308] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.079488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.079540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.079788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.079887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.080117] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.080265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.080388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.080587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.080678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.080888] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.080986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.081119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.081355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.081446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.081566] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 850.136289] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.136474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.136474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.136705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.136902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.150900] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 850.329057] env[69358]: INFO networking_nsxv3.common.synchronization [req-ca9b281e-b7cd-44ff-b081-13ac069775d4 req-1d1d6b5e-b7f1-4ea1-966a-7013320d9475 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 850.329698] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 850.330291] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.330291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.330439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.330681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.330868] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.331031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.331156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.331314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.331426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.331538] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.777448] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.777723] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.777801] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.778111] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.778379] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.778546] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.778642] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.778866] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.779018] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.779244] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.779362] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.779469] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.779578] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.779687] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.779794] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.779925] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.798361] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.798628] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 850.798678] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.798817] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.799145] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-ed2b7619-adeb-46c9-822e-732f8dba2371 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.799322] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-ed2b7619-adeb-46c9-822e-732f8dba2371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.799444] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-ed2b7619-adeb-46c9-822e-732f8dba2371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.799771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-ed2b7619-adeb-46c9-822e-732f8dba2371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.799980] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed2b7619-adeb-46c9-822e-732f8dba2371',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.833323] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.833599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.833827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.834077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.834264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.835030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.835030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.835030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.835030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.835030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.835030] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 already deleted. [ 850.835356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.302618] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.303310] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.303310] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.303456] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.304030] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.304030] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port ed2b7619-adeb-46c9-822e-732f8dba2371 not found, creating... [ 851.304185] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.304307] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.304455] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.304679] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.304824] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.305158] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.305373] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.305503] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.305760] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.305936] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.306097] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: ed2b7619-adeb-46c9-822e-732f8dba2371 is going to be created. [ 851.328767] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.328988] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.329132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.329393] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.329614] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.329840] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-ed2b7619-adeb-46c9-822e-732f8dba2371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.438199] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: SUCCESS [ 851.438459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.165144] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 852.165359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.165681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.166210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.166210] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.174058] env[69358]: INFO networking_nsxv3.common.synchronization [req-ca9b281e-b7cd-44ff-b081-13ac069775d4 req-783981c6-0995-4208-bb4f-858bdb795dc9 service nova] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_rules [ 852.174331] env[69358]: INFO networking_nsxv3.common.synchronization [req-ca9b281e-b7cd-44ff-b081-13ac069775d4 req-783981c6-0995-4208-bb4f-858bdb795dc9 service nova] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 852.174617] env[69358]: INFO networking_nsxv3.common.synchronization [req-ca9b281e-b7cd-44ff-b081-13ac069775d4 req-783981c6-0995-4208-bb4f-858bdb795dc9 service nova] Enqueued Resource ID: ed2b7619-adeb-46c9-822e-732f8dba2371 with Priority: HIGHEST for action port [ 852.174756] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_rules [ 852.174886] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 852.174984] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2b7619-adeb-46c9-822e-732f8dba2371 with Priority: HIGHEST for action port [ 852.175576] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.175743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.175779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.175948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.176675] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.177862] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.177862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.178053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.178180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.178410] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.178514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.178567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.178691] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.178806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.178913] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.180069] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed2b7619-adeb-46c9-822e-732f8dba2371 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.180233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed2b7619-adeb-46c9-822e-732f8dba2371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.180337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed2b7619-adeb-46c9-822e-732f8dba2371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.180552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed2b7619-adeb-46c9-822e-732f8dba2371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.180671] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed2b7619-adeb-46c9-822e-732f8dba2371',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.669262] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.669606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.669606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.669687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.669845] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.669941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.670008] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.670163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.670248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.670338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.670427] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.682169] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.683353] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.683353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.685167] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed2b7619-adeb-46c9-822e-732f8dba2371 with status ACTIVE [ 852.685304] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.685419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.685496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.685716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.685821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.685996] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.686122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.686186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.686340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.686425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.686591] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.686682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.686735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.686874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.686949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.687043] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed2b7619-adeb-46c9-822e-732f8dba2371 is going to be updated. [ 852.714828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.715052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.715052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.715417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.715670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.715832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed2b7619-adeb-46c9-822e-732f8dba2371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.172509] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.172657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.173598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.173598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.173598] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.173598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.173598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.173598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.173598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.173957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.173957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.173957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.173957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.174109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.174280] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.174400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.174400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.174541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.174696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.174696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.174825] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.183806] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.678162] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55e4213-4f47-44ae-b8e8-d46185e8161b: rpc.has_security_group_logging(os_id): False [ 853.686019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.686279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.686388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.686636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.686774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.686919] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 is going to be created. [ 853.700324] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.700509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.700601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.700817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.700910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.701116] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.701236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.701269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.701445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.701479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.701657] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.701775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.701844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.701983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.702104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.702396] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.702502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.702566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.703261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.703509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.703663] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 853.709392] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.710658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.710658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.710658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.710658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.719961] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: UNINITIALIZED for 2s [ 853.775145] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.776914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.776914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.776914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.776914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.791796] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 855.731836] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: SUCCESS [ 855.732076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.732234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.732447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.732640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.732790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.732842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.732966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.733060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.733194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.733281] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.814496] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 855.814716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.007892] env[69358]: INFO networking_nsxv3.common.synchronization [req-f09bc50b-87b5-43f4-b5d9-b08153a24e32 req-8edb86d2-e919-482d-81b8-e59f3148386b tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 856.008166] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 856.008690] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.009084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.009084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.009084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.009229] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.009316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.009377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.009523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.009609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.009699] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.236118] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.288207] env[69358]: INFO networking_nsxv3.common.synchronization [req-f09bc50b-87b5-43f4-b5d9-b08153a24e32 req-2cfe3d22-1033-4883-83af-50180818f0b9 tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 856.288481] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 856.289992] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.290155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.516625] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.587020] env[69358]: INFO networking_nsxv3.common.synchronization [req-f09bc50b-87b5-43f4-b5d9-b08153a24e32 req-657d4bfc-4938-4a93-ba0c-672c6ead2450 tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 856.587733] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 856.589023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.589201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.739271] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32d20126-9c39-42b2-acda-4aa519da54c6: rpc.has_security_group_logging(os_id): False [ 856.757934] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.758093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.758156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.758368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.758460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.758699] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.758802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.758866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.759090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.759182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.759287] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 is going to be created. [ 856.812268] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.812454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.812549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.812812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.813042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.824102] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: IN_PROGRESS for 2s [ 857.015228] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.518118] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.518286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.518351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.518588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.518714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.518819] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 857.543330] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.543478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.543547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.543739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.543877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.552362] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 858.837457] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: SUCCESS [ 858.837757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.563028] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 859.563292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.563524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.563802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.564036] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.564162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.564243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.564408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.564494] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.564616] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.067506] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.067785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.067785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.068098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.068268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.068520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.068675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.068788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.068982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.069124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.069239] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 860.097044] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.098397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.098397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.098397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.098397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.108464] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 861.028643] env[69358]: INFO networking_nsxv3.common.synchronization [req-90a43dea-5912-4842-b916-0a8c742b0aa7 req-64c09748-1e79-432a-8763-55f259311d42 tempest-ServersAdminNegativeTestJSON-1854851698 tempest-ServersAdminNegativeTestJSON-1854851698-project-member] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 861.029296] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 861.029537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.029683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.029754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.029951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.030128] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.030226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.030289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.030439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.030527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.030622] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.408856] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.408856] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.408856] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.408856] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.409260] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.409260] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.409260] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.409441] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.409584] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.409787] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.409897] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.410012] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.410120] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.410227] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.410329] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.410456] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.440643] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.440812] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.440996] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.441149] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.441518] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-7dee2f83-32e0-4894-bd76-1a960d31f6d4 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.441725] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-7dee2f83-32e0-4894-bd76-1a960d31f6d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.442651] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-7dee2f83-32e0-4894-bd76-1a960d31f6d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.442651] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-7dee2f83-32e0-4894-bd76-1a960d31f6d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.442651] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dee2f83-32e0-4894-bd76-1a960d31f6d4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.532984] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.945178] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.945889] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.945889] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.945889] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.946147] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.946205] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 7dee2f83-32e0-4894-bd76-1a960d31f6d4 not found, creating... [ 861.946466] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.946642] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.946766] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.946986] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.947152] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.947432] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.947602] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.947724] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.947932] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.948078] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.948219] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 7dee2f83-32e0-4894-bd76-1a960d31f6d4 is going to be created. [ 861.968298] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.968515] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.968618] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.968877] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.969111] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.969358] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-7dee2f83-32e0-4894-bd76-1a960d31f6d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.037929] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.120065] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 862.120065] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b deletion is rescheduled due to dependency. [ 862.120065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.120282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.120569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.120727] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.120853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.120920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.121099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.121207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.121309] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.539415] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.542592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.542592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.542592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.542592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.542592] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be updated. [ 862.569293] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.569293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.569293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.569293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.569293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.578534] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: IN_PROGRESS for 2s [ 862.624271] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.624271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.624474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.624664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.624776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.624970] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.625151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.625151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.625298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.625365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.625435] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 862.649673] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.649673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.649673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.649913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.649913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.658729] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 862.720342] env[69358]: INFO networking_nsxv3.common.synchronization [req-90a43dea-5912-4842-b916-0a8c742b0aa7 req-78a63f59-fd35-4020-b6a7-311e60c76262 service nova] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_rules [ 862.720515] env[69358]: INFO networking_nsxv3.common.synchronization [req-90a43dea-5912-4842-b916-0a8c742b0aa7 req-78a63f59-fd35-4020-b6a7-311e60c76262 service nova] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 862.720652] env[69358]: INFO networking_nsxv3.common.synchronization [req-90a43dea-5912-4842-b916-0a8c742b0aa7 req-78a63f59-fd35-4020-b6a7-311e60c76262 service nova] Enqueued Resource ID: 7dee2f83-32e0-4894-bd76-1a960d31f6d4 with Priority: HIGHEST for action port [ 862.720896] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_rules [ 862.721026] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 862.721125] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dee2f83-32e0-4894-bd76-1a960d31f6d4 with Priority: HIGHEST for action port [ 862.721689] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.721809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.721929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.722292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.722292] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.723148] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.723258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.723451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dee2f83-32e0-4894-bd76-1a960d31f6d4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.723558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dee2f83-32e0-4894-bd76-1a960d31f6d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.723614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dee2f83-32e0-4894-bd76-1a960d31f6d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.723771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dee2f83-32e0-4894-bd76-1a960d31f6d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.723837] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dee2f83-32e0-4894-bd76-1a960d31f6d4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.227398] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.227483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.227669] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7dee2f83-32e0-4894-bd76-1a960d31f6d4 with status ACTIVE [ 863.227870] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.227927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.228027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.228218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.228308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.228477] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.228574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.228633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.228772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.228851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.229038] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.229132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.229194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.229332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.229406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.229489] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7dee2f83-32e0-4894-bd76-1a960d31f6d4 is going to be updated. [ 863.250664] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.250803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.250882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.251100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.251590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.251739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dee2f83-32e0-4894-bd76-1a960d31f6d4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.666291] env[69358]: INFO networking_nsxv3.common.synchronization [req-e10200f7-ae3c-4055-a6c3-742bc5354580 req-e0980d74-2810-4779-9c4c-ff25fea6f1ec tempest-ServerRescueNegativeTestJSON-1118501628 tempest-ServerRescueNegativeTestJSON-1118501628-project-member] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 863.666791] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 863.667287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.667420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.667489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.668313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.668520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.668669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.668742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.668931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.668983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.669094] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.033179] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.033400] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.033757] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.034475] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.036047] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.036047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.036047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.036047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.036047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.036497] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.036497] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.036578] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.036832] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.036832] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.036955] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.037169] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.055883] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.056168] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 864.056384] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.056581] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.056961] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-25c2a5fe-b880-4890-8cdd-af26e44f6311 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.057158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-25c2a5fe-b880-4890-8cdd-af26e44f6311" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.057302] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-25c2a5fe-b880-4890-8cdd-af26e44f6311" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.057676] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-25c2a5fe-b880-4890-8cdd-af26e44f6311" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.057829] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25c2a5fe-b880-4890-8cdd-af26e44f6311',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.170980] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.171212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.171284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.171491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.171593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.171791] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.171905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.171966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.172147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.172227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.172314] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f22bfa82-0766-4940-b70e-28b7b023248e already deleted. [ 864.172405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.561038] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.561296] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.561477] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.561778] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.561934] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.562116] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 25c2a5fe-b880-4890-8cdd-af26e44f6311 not found, creating... [ 864.562398] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.562574] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.562698] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.562930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.563105] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.563405] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.563598] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.563729] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.563946] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.564107] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.564258] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 25c2a5fe-b880-4890-8cdd-af26e44f6311 is going to be created. [ 864.583239] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.583528] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.583669] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.583914] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.584179] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.584500] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-25c2a5fe-b880-4890-8cdd-af26e44f6311" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.588251] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: SUCCESS [ 864.588459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.588616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.588823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.589020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.589152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.589219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.589391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.589476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.589558] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.672412] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 864.672412] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b deletion is rescheduled due to dependency. [ 864.672412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.949714] env[69358]: INFO networking_nsxv3.common.synchronization [req-c2d143ad-f811-4275-8ddc-25390a591ec1 req-b1382493-2850-4301-8779-851020ff5c2f tempest-ServersWithSpecificFlavorTestJSON-1142878247 tempest-ServersWithSpecificFlavorTestJSON-1142878247-project-member] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 864.949714] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 864.949714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.949714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.949714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.950656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.950958] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.951629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.951797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.952071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.952312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.952506] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.092668] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.377047] env[69358]: INFO networking_nsxv3.common.synchronization [req-e10200f7-ae3c-4055-a6c3-742bc5354580 req-8b7d90b2-cf44-435f-b35d-b6e2fcfa6a7e service nova] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_rules [ 865.377248] env[69358]: INFO networking_nsxv3.common.synchronization [req-e10200f7-ae3c-4055-a6c3-742bc5354580 req-8b7d90b2-cf44-435f-b35d-b6e2fcfa6a7e service nova] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 865.381060] env[69358]: INFO networking_nsxv3.common.synchronization [req-e10200f7-ae3c-4055-a6c3-742bc5354580 req-8b7d90b2-cf44-435f-b35d-b6e2fcfa6a7e service nova] Enqueued Resource ID: 25c2a5fe-b880-4890-8cdd-af26e44f6311 with Priority: HIGHEST for action port [ 865.381403] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_rules [ 865.381876] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 865.381876] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2a5fe-b880-4890-8cdd-af26e44f6311 with Priority: HIGHEST for action port [ 865.385572] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.385572] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.385572] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.385572] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.385572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.385572] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.387351] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-25c2a5fe-b880-4890-8cdd-af26e44f6311 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.387351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25c2a5fe-b880-4890-8cdd-af26e44f6311" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.387351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25c2a5fe-b880-4890-8cdd-af26e44f6311" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.387351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25c2a5fe-b880-4890-8cdd-af26e44f6311" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.387351] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25c2a5fe-b880-4890-8cdd-af26e44f6311',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.455815] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.456122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.456122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.456521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.456679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.457095] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.457234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.457378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.457640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.457727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.457862] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be updated. [ 865.483597] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.483757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.483821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.484271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.484271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.493418] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: IN_PROGRESS for 2s [ 865.597252] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.888597] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.891816] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.891816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.892150] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25c2a5fe-b880-4890-8cdd-af26e44f6311 with status ACTIVE [ 865.892319] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.892449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.892589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.892800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.892962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.893254] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.893254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.893254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.893408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.893502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.893697] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.893807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.893867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.894054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.894134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.894185] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25c2a5fe-b880-4890-8cdd-af26e44f6311 is going to be updated. [ 865.914311] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.914526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.914526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.914754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.914828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.914978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25c2a5fe-b880-4890-8cdd-af26e44f6311" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.102574] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.102664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.102702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.103092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.103092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.103489] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be updated. [ 866.198716] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.198870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.199503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.199503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.199503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.220617] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: IN_PROGRESS for 2s [ 866.309367] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c288d2e-36ca-44c7-834f-cf83b14f01bc req-3529703d-8854-4867-a24a-3e9d8890e8ff tempest-ServerRescueNegativeTestJSON-1118501628 tempest-ServerRescueNegativeTestJSON-1118501628-project-member] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 866.309945] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 866.310263] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.310363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.392563] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.674466] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.674466] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.674466] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.674466] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.674466] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.674466] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.674466] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.674466] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.674466] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.674466] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.674466] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.674466] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.674466] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.674987] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.674987] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.674987] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.694103] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.694103] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 866.694103] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.694103] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.694103] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e345906a-ab18-4470-9662-8fdc65497bc0 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.694103] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e345906a-ab18-4470-9662-8fdc65497bc0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.694103] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e345906a-ab18-4470-9662-8fdc65497bc0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.694447] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e345906a-ab18-4470-9662-8fdc65497bc0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.694484] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e345906a-ab18-4470-9662-8fdc65497bc0',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.895111] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.895111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.895111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.895111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.895111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.895628] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be created. [ 866.917556] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.917878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.917878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.918095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.918202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.926653] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: UNINITIALIZED for 2s [ 867.199059] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.199366] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.199502] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.199819] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.200024] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.200269] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e345906a-ab18-4470-9662-8fdc65497bc0 not found, creating... [ 867.200607] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.200799] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.200997] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.201404] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.201639] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.203288] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.203288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.203288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.203288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.203288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.203288] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e345906a-ab18-4470-9662-8fdc65497bc0 is going to be created. [ 867.240249] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.240610] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.240736] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.240944] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.241276] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.241453] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e345906a-ab18-4470-9662-8fdc65497bc0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.504748] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: SUCCESS [ 867.504939] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b deletion is rescheduled due to dependency. [ 867.505075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.017971] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c288d2e-36ca-44c7-834f-cf83b14f01bc req-1bacfae0-5066-43a1-bfd5-b30f722aad8f service nova] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_rules [ 868.018279] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c288d2e-36ca-44c7-834f-cf83b14f01bc req-1bacfae0-5066-43a1-bfd5-b30f722aad8f service nova] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 868.018379] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c288d2e-36ca-44c7-834f-cf83b14f01bc req-1bacfae0-5066-43a1-bfd5-b30f722aad8f service nova] Enqueued Resource ID: e345906a-ab18-4470-9662-8fdc65497bc0 with Priority: HIGHEST for action port [ 868.018575] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_rules [ 868.018666] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 868.018767] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e345906a-ab18-4470-9662-8fdc65497bc0 with Priority: HIGHEST for action port [ 868.019408] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.019536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.019745] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.019829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.020008] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e345906a-ab18-4470-9662-8fdc65497bc0 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.021213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e345906a-ab18-4470-9662-8fdc65497bc0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.021301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e345906a-ab18-4470-9662-8fdc65497bc0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.021545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e345906a-ab18-4470-9662-8fdc65497bc0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.021636] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e345906a-ab18-4470-9662-8fdc65497bc0',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.232021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: SUCCESS [ 868.232021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.232021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.232021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.232021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.232021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.232021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.232021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.232021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.232021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.232021] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.525206] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e345906a-ab18-4470-9662-8fdc65497bc0 with status ACTIVE [ 868.525285] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.525420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.525488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.525692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.526620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.526620] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.526620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.526620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.526620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.526620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.526620] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.526620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.526620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.527048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.527048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.527048] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e345906a-ab18-4470-9662-8fdc65497bc0 is going to be updated. [ 868.547917] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.547917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.548164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.548164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.548304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.548568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e345906a-ab18-4470-9662-8fdc65497bc0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.735122] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.735290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.735364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.735632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.735812] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.735943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.736039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.736147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.736236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.736346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.736473] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.736565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.736664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.736812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.736952] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.737060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.737124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.737256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.737335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.737437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.737535] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.939455] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: SUCCESS [ 868.939738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.939912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.940137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.942025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.942025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.942025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.942025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.942025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.942025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.942025] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.942025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.942025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.942432] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.942432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.942515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.942728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.942807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.942898] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.239559] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c2d1cb5-beda-4718-964c-8cbc07452049: rpc.has_security_group_logging(os_id): False [ 869.256921] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.256921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.256921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.256921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.257172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.257232] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.257452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.257452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.257560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.257601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.257764] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.257850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.257907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.258050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.258119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.258291] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.258373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.258432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.259425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.259425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.259425] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be updated. [ 869.313073] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.313291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.313291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.313481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.313849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.325089] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: IN_PROGRESS for 2s [ 869.445129] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.445507] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.445507] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.947906] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.451019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.451402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.451402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.452177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.452376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.452503] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be updated. [ 870.481935] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.482158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.482246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.482527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.482702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.495482] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: IN_PROGRESS for 2s [ 871.337502] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: SUCCESS [ 871.338043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.660117] env[69358]: INFO networking_nsxv3.common.synchronization [req-e972521b-783b-47d3-996f-b45c4c16efaa req-8be8108d-0783-4adc-aae8-d0a4da2d0cc6 tempest-ServersAdminTestJSON-846589263 tempest-ServersAdminTestJSON-846589263-project-member] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 871.661531] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 871.661531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.661531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.661531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.662032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.662032] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.662182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.662182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.662276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.662375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.662476] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.165558] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.507194] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: SUCCESS [ 872.508242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.508242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.508242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.508242] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.508242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.508242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.508516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.508516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.508516] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.669210] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.012081] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.171547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.171812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.171917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.172203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.172301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.172405] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 873.197890] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.198116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.198217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.198510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.198718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.206795] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 873.515303] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.019344] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.019344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.019344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.019344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.019344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.019344] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be updated. [ 874.043114] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.043114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.043296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.043346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.043484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.051623] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: IN_PROGRESS for 2s [ 874.193305] env[69358]: INFO networking_nsxv3.common.synchronization [req-eb2f385d-83fc-47aa-a458-3156ea0ef6c6 req-0229ce6c-a925-405e-8802-914f49df3640 tempest-ServerGroupTestJSON-560475170 tempest-ServerGroupTestJSON-560475170-project-member] Enqueued Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGHEST for action security_group_members [ 874.194061] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGHEST for action security_group_members [ 874.194414] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af2cb3a-4662-4499-98ee-9085e996828e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.194946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.194946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.195099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.195225] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.195339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.195405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.195566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.195653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.195843] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.608414] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.608685] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-418" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.608911] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-418" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.609325] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-418" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.609722] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.609921] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.610088] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.610379] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.610575] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.610851] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.611023] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.611177] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.611330] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.611486] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.611676] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.611823] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.630031] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.630225] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 874.630486] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.630782] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-418" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.631278] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.631570] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.631773] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.632375] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.632488] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d5a7709-cf32-4eda-8bf4-ca7121f16c2a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.697725] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.697888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.697951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.698184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.698298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.698465] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.698751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.698751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.698949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.698949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.698949] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af2cb3a-4662-4499-98ee-9085e996828e already deleted. [ 874.699095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.135166] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.135610] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.135610] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.135805] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.135959] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.136170] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 7d5a7709-cf32-4eda-8bf4-ca7121f16c2a not found, creating... [ 875.136480] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.136662] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.136786] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.137037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.137184] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.137471] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.137635] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.137756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.137971] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.138130] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.138304] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 7d5a7709-cf32-4eda-8bf4-ca7121f16c2a is going to be created. [ 875.162471] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.162703] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.162834] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.163143] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.163379] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.163619] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.224777] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 875.225027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.439116] env[69358]: INFO networking_nsxv3.common.synchronization [req-39337cf4-6645-4729-a542-a105bc1e01f3 req-ae47f4ed-b7b2-412f-95af-5b77852d299e tempest-ServersTestFqdnHostnames-758146594 tempest-ServersTestFqdnHostnames-758146594-project-member] Enqueued Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_members [ 875.439573] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGHEST for action security_group_members [ 875.440604] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4d32ff-0296-4f24-a97d-f033779cef5a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.440855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.441016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.441244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.441653] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.441761] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.441803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.442017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.442501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.442501] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.910580] env[69358]: INFO networking_nsxv3.common.synchronization [req-eb2f385d-83fc-47aa-a458-3156ea0ef6c6 req-f221d55d-73ec-46a4-bba3-06c089d278fa service nova] Enqueued Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGHEST for action security_group_rules [ 875.910755] env[69358]: INFO networking_nsxv3.common.synchronization [req-eb2f385d-83fc-47aa-a458-3156ea0ef6c6 req-f221d55d-73ec-46a4-bba3-06c089d278fa service nova] Enqueued Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGHEST for action security_group_members [ 875.910940] env[69358]: INFO networking_nsxv3.common.synchronization [req-eb2f385d-83fc-47aa-a458-3156ea0ef6c6 req-f221d55d-73ec-46a4-bba3-06c089d278fa service nova] Enqueued Resource ID: 7d5a7709-cf32-4eda-8bf4-ca7121f16c2a with Priority: HIGHEST for action port [ 875.912661] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGHEST for action security_group_rules [ 875.912971] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGHEST for action security_group_members [ 875.916017] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d5a7709-cf32-4eda-8bf4-ca7121f16c2a with Priority: HIGHEST for action port [ 875.916017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1af2cb3a-4662-4499-98ee-9085e996828e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.916017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.916017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af2cb3a-4662-4499-98ee-9085e996828e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.916017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.916017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.916792] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.917638] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.917909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.918087] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.918323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.918527] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d5a7709-cf32-4eda-8bf4-ca7121f16c2a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.948023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.948023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.948023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.948023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.948023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.948023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.948023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.948023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.948023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.948023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.948023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4d32ff-0296-4f24-a97d-f033779cef5a is going to be updated. [ 875.973189] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.973346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.973396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.973597] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.973801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.981685] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4d32ff-0296-4f24-a97d-f033779cef5a in Status: IN_PROGRESS for 2s [ 876.059775] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: SUCCESS [ 876.059937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.060113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.060321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.060511] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.060687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.060687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.060825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.060906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.060988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.061149] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.061242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.061302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.061438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.061619] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.061726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.061790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.061931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.062013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.062105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.062193] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.420305] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.422066] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af2cb3a-4662-4499-98ee-9085e996828e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.422379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.424171] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d5a7709-cf32-4eda-8bf4-ca7121f16c2a with status ACTIVE [ 876.424171] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.424171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.424171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.424171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.424171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.424171] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.424614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.424614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.424614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.424614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.424741] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.424856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.424902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.425183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.425183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.425267] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d5a7709-cf32-4eda-8bf4-ca7121f16c2a is going to be updated. [ 876.446080] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.446080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.446080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.446080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.446080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.446080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d5a7709-cf32-4eda-8bf4-ca7121f16c2a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.565290] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f22bfa82-0766-4940-b70e-28b7b023248e: rpc.has_security_group_logging(os_id): False [ 876.588071] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.588287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.588287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.588512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.588591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.588808] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.589028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.589028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.589127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.589200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.589370] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.589484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.589519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.589685] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.589797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.589891] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.589979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.590049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.590185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.590324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.590324] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be created. [ 876.662975] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.663298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.663298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.663425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.663619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.678348] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: IN_PROGRESS for 2s [ 876.770457] env[69358]: INFO networking_nsxv3.common.synchronization [req-848f9760-d941-43f3-8741-e8caab59c700 req-5295ded0-6775-4b89-9b80-2896f112177f tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 876.770935] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 876.771251] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.771376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.771434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.771638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.771812] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.771917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.771979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.772140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.772224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.772373] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.924394] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.156854] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.156854] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.156854] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.156854] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.156854] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.156854] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.156854] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.157352] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.157780] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.158179] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.158419] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.158685] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.159312] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.159629] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.159982] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.160463] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.179852] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.179852] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 877.179852] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.179852] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.180146] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-edcd466f-0698-4bbf-afe5-e1207673600e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.180832] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-edcd466f-0698-4bbf-afe5-e1207673600e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.180832] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-edcd466f-0698-4bbf-afe5-e1207673600e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.180832] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-edcd466f-0698-4bbf-afe5-e1207673600e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.180832] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edcd466f-0698-4bbf-afe5-e1207673600e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.274793] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.274975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.275355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.275604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.275700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.276118] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.276244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.276287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.276451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.276585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.276634] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 877.306948] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.307429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.307429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.307544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.307579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.315877] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 877.426630] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.426932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.427090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.427258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.427376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.427444] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af2cb3a-4662-4499-98ee-9085e996828e is going to be created. [ 877.451034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.451180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.451242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.451528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.451592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.464035] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af2cb3a-4662-4499-98ee-9085e996828e in Status: UNINITIALIZED for 2s [ 877.683910] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.685771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.685771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.685771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.685771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.685771] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port edcd466f-0698-4bbf-afe5-e1207673600e not found, creating... [ 877.685771] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.685771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.685771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.686195] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.686338] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.686693] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.686938] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.687143] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.687429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.687654] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.687830] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: edcd466f-0698-4bbf-afe5-e1207673600e is going to be created. [ 877.706323] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.707013] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.707013] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.707013] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.707398] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.707478] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-edcd466f-0698-4bbf-afe5-e1207673600e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.995093] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4d32ff-0296-4f24-a97d-f033779cef5a in Status: SUCCESS [ 877.995289] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4d32ff-0296-4f24-a97d-f033779cef5a deletion is rescheduled due to dependency. [ 877.995412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.480308] env[69358]: INFO networking_nsxv3.common.synchronization [req-848f9760-d941-43f3-8741-e8caab59c700 req-364e540a-7991-43a9-b5d2-76623216a384 service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 878.480308] env[69358]: INFO networking_nsxv3.common.synchronization [req-848f9760-d941-43f3-8741-e8caab59c700 req-364e540a-7991-43a9-b5d2-76623216a384 service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 878.480308] env[69358]: INFO networking_nsxv3.common.synchronization [req-848f9760-d941-43f3-8741-e8caab59c700 req-364e540a-7991-43a9-b5d2-76623216a384 service nova] Enqueued Resource ID: edcd466f-0698-4bbf-afe5-e1207673600e with Priority: HIGHEST for action port [ 878.480308] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 878.480308] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 878.480308] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd466f-0698-4bbf-afe5-e1207673600e with Priority: HIGHEST for action port [ 878.481332] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.481332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.485117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.485347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.485438] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.486328] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.487011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.487011] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-edcd466f-0698-4bbf-afe5-e1207673600e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.487011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edcd466f-0698-4bbf-afe5-e1207673600e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.487011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edcd466f-0698-4bbf-afe5-e1207673600e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.491222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edcd466f-0698-4bbf-afe5-e1207673600e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.491305] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edcd466f-0698-4bbf-afe5-e1207673600e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.687656] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: SUCCESS [ 878.687878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.688063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.688282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.688372] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.993694] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.993694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.993694] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port edcd466f-0698-4bbf-afe5-e1207673600e with status ACTIVE [ 878.993930] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.994071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.994105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.994566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.994566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.994566] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.994732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.994732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.994803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.994898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.995100] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.995256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.995256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.995391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.995466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.995548] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: edcd466f-0698-4bbf-afe5-e1207673600e is going to be updated. [ 879.015456] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.015456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.015804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.015804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.015804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.015955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edcd466f-0698-4bbf-afe5-e1207673600e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.194129] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.194299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.194367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.194578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.194744] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.194862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.194922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.195105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.195468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.195468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.195468] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.324868] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 879.325066] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 879.325185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.325350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.325583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.325764] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.325867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.325933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.326105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.326227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.326279] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.350231] env[69358]: INFO networking_nsxv3.common.synchronization [req-99dca481-b628-43cc-a94f-c30a10b2c889 req-adc311e8-6458-4892-b4c6-e67b92e5d48d tempest-ServerDiagnosticsTest-1847944580 tempest-ServerDiagnosticsTest-1847944580-project-member] Enqueued Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGHEST for action security_group_members [ 879.350945] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGHEST for action security_group_members [ 879.351613] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.351613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.351613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.351818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.351992] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.353272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.353272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.353272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.353272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.353272] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.472471] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af2cb3a-4662-4499-98ee-9085e996828e in Status: SUCCESS [ 879.472681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.473193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.473193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.473371] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.473521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.473589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.473822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.473963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.473963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.474061] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.700020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.700020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.700020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.700020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.700020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.700901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.700901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.700901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.700901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.700901] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.830135] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.855395] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.855395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.855544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.858837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.858837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.858837] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.858837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.858837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.858837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.858837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.858837] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 already deleted. [ 879.858837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.865692] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.865877] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.866028] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.866307] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.866577] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.866737] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.866932] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.867614] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.867848] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.868123] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.868421] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.868636] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.868801] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.868980] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.869167] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.870710] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.888036] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.888924] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 879.888924] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.888924] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.888924] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-737dfe1d-79cd-418c-9043-4fc2302b8da8 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.889131] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-737dfe1d-79cd-418c-9043-4fc2302b8da8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.889206] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-737dfe1d-79cd-418c-9043-4fc2302b8da8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.891217] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-737dfe1d-79cd-418c-9043-4fc2302b8da8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.891217] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('737dfe1d-79cd-418c-9043-4fc2302b8da8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.976422] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af2cb3a-4662-4499-98ee-9085e996828e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.976422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.976422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.976745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.976935] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.977067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.977140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.977281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.977397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.977475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.977629] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af2cb3a-4662-4499-98ee-9085e996828e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.977731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.977806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.977970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.978124] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.978235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.978306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.978418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.978487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.978562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.978658] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.086949] env[69358]: INFO networking_nsxv3.common.synchronization [req-108d97b6-6219-4c72-b0bf-fa28a2557ba2 req-af13ffd3-a2d4-4026-a0ed-96c4c50462ec tempest-ServersAdminNegativeTestJSON-1854851698 tempest-ServersAdminNegativeTestJSON-1854851698-project-member] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 880.086949] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 880.086949] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.086949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.087135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.087248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.087343] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.087967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.087967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.088175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.088175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.088175] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.204899] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f22bfa82-0766-4940-b70e-28b7b023248e: rpc.has_security_group_logging(os_id): False [ 880.221352] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.221524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.221566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.222231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.222231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.222231] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.222422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.222422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.222488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.222574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.222721] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.222839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.223014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.223104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.223154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.223308] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.223395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.223639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.223874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.223974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.224083] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be updated. [ 880.279211] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.279379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.279431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.279629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.279777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.291126] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: IN_PROGRESS for 2s [ 880.330652] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.393293] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.393537] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.393671] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.394150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.394318] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.394478] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 737dfe1d-79cd-418c-9043-4fc2302b8da8 not found, creating... [ 880.394791] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.394988] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.395194] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.395360] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.395502] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.395800] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.395961] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.396121] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.396344] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.396481] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.396628] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 737dfe1d-79cd-418c-9043-4fc2302b8da8 is going to be created. [ 880.418184] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.418520] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.418682] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.418983] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.419216] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.419467] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-737dfe1d-79cd-418c-9043-4fc2302b8da8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.481868] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1af2cb3a-4662-4499-98ee-9085e996828e: rpc.has_security_group_logging(os_id): False [ 880.507772] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.507921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.508018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.508235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.508329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.508543] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.508644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.508705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.509234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.509234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.509234] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.509234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.509512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.509512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.509512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.509655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.509754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.509813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.509938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.510016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.510100] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1af2cb3a-4662-4499-98ee-9085e996828e is going to be created. [ 880.591167] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.603092] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.603092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.603092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.603303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.603627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.630025] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1af2cb3a-4662-4499-98ee-9085e996828e in Status: IN_PROGRESS for 2s [ 880.833327] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.833678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.833678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.834257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.834257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.834257] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 880.867017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.867017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.867017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.867017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.867017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.873419] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 881.093398] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.243889] env[69358]: INFO networking_nsxv3.common.synchronization [req-99dca481-b628-43cc-a94f-c30a10b2c889 req-4e0739e7-2045-4039-b90a-a8c35a8309ff service nova] Enqueued Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGHEST for action security_group_rules [ 881.244245] env[69358]: INFO networking_nsxv3.common.synchronization [req-99dca481-b628-43cc-a94f-c30a10b2c889 req-4e0739e7-2045-4039-b90a-a8c35a8309ff service nova] Enqueued Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGHEST for action security_group_members [ 881.244391] env[69358]: INFO networking_nsxv3.common.synchronization [req-99dca481-b628-43cc-a94f-c30a10b2c889 req-4e0739e7-2045-4039-b90a-a8c35a8309ff service nova] Enqueued Resource ID: 737dfe1d-79cd-418c-9043-4fc2302b8da8 with Priority: HIGHEST for action port [ 881.244911] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGHEST for action security_group_rules [ 881.246922] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGHEST for action security_group_members [ 881.247085] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 737dfe1d-79cd-418c-9043-4fc2302b8da8 with Priority: HIGHEST for action port [ 881.247831] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.247831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.247831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.248095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.248290] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.249988] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.250135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.250227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.250428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.250577] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.250672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.250734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.250873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.251044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.251100] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.251845] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-737dfe1d-79cd-418c-9043-4fc2302b8da8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.251951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-737dfe1d-79cd-418c-9043-4fc2302b8da8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.251993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-737dfe1d-79cd-418c-9043-4fc2302b8da8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.255315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-737dfe1d-79cd-418c-9043-4fc2302b8da8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.255315] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('737dfe1d-79cd-418c-9043-4fc2302b8da8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.595411] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.596239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.596239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.596239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.596239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.596239] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be updated. [ 881.635992] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.636199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.636310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.636539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.636713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.645426] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: IN_PROGRESS for 2s [ 881.754690] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.755192] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.755329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.757739] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 737dfe1d-79cd-418c-9043-4fc2302b8da8 with status ACTIVE [ 881.757739] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.757887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.758506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.758506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.758506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.758655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.758770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.758871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.759125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.759250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.759454] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.759571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.759638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.759811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.760032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.760032] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 737dfe1d-79cd-418c-9043-4fc2302b8da8 is going to be updated. [ 881.781136] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.781136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.781136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.781136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.781464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.781464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-737dfe1d-79cd-418c-9043-4fc2302b8da8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.942480] env[69358]: INFO networking_nsxv3.common.synchronization [req-dfa42360-2c34-4928-842c-315936f81b14 req-e05a94e9-6bd3-4a0d-a266-4ed7e35e70ee tempest-ServerMetadataNegativeTestJSON-235946287 tempest-ServerMetadataNegativeTestJSON-235946287-project-member] Enqueued Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGHEST for action security_group_members [ 881.942480] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGHEST for action security_group_members [ 881.942773] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.944171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.944171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.944171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.944171] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.944171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.944171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.944171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.944171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.944171] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.256671] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.303910] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: SUCCESS [ 882.304470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.399622] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.400384] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-740" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.400384] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-740" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.400545] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-740" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.400805] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.400987] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.401144] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.401399] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.401562] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.401794] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.401934] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.402087] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.402219] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.402372] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.402546] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.402728] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.433965] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.433965] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.433965] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.435408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-740" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.435408] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-9a314dd7-ac32-4d92-a106-a4681e379db5 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.435408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-9a314dd7-ac32-4d92-a106-a4681e379db5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.435408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-9a314dd7-ac32-4d92-a106-a4681e379db5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.435408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-9a314dd7-ac32-4d92-a106-a4681e379db5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.435408] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a314dd7-ac32-4d92-a106-a4681e379db5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.448069] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.448233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.448314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.448519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.448603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.449581] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.449581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.449581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.449581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.449581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.449581] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a already deleted. [ 882.449581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.642111] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1af2cb3a-4662-4499-98ee-9085e996828e in Status: SUCCESS [ 882.642257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.759266] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.759447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.759497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.759706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.759812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.759942] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 is going to be created. [ 882.782897] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.783093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.783156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.784024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.784024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.791494] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 in Status: UNINITIALIZED for 2s [ 882.882725] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 882.882982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.883098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.883317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.883509] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.883624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.883681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.883868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.883969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.884073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.884166] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.938288] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.938288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.938288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.938501] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.938645] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.938794] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 9a314dd7-ac32-4d92-a106-a4681e379db5 not found, creating... [ 882.939065] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.939224] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.939341] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.939555] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.939687] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.939963] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.940140] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.940255] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.940748] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.940748] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.940748] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 9a314dd7-ac32-4d92-a106-a4681e379db5 is going to be created. [ 882.959094] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.959434] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.959434] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.959671] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.959889] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.960128] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-9a314dd7-ac32-4d92-a106-a4681e379db5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.386293] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.386487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.386547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.386756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.386933] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.387071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.387139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.387272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.387395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.387493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.387649] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.387737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.387792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.387937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.388094] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.388173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.388235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.388370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.388445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.388525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.388633] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.658039] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: SUCCESS [ 883.658581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.841528] env[69358]: INFO networking_nsxv3.common.synchronization [req-dfa42360-2c34-4928-842c-315936f81b14 req-5ab0a647-b12c-4abe-9333-ddfb313a63c9 service nova] Enqueued Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGHEST for action security_group_rules [ 883.842040] env[69358]: INFO networking_nsxv3.common.synchronization [req-dfa42360-2c34-4928-842c-315936f81b14 req-5ab0a647-b12c-4abe-9333-ddfb313a63c9 service nova] Enqueued Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGHEST for action security_group_members [ 883.842040] env[69358]: INFO networking_nsxv3.common.synchronization [req-dfa42360-2c34-4928-842c-315936f81b14 req-5ab0a647-b12c-4abe-9333-ddfb313a63c9 service nova] Enqueued Resource ID: 9a314dd7-ac32-4d92-a106-a4681e379db5 with Priority: HIGHEST for action port [ 883.842297] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGHEST for action security_group_rules [ 883.842297] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGHEST for action security_group_members [ 883.842415] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a314dd7-ac32-4d92-a106-a4681e379db5 with Priority: HIGHEST for action port [ 883.842997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.843408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.843408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.843569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.843681] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.844822] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.844920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.844920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.845323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.845323] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.845502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.845502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.845582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.845665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.845748] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.846938] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a314dd7-ac32-4d92-a106-a4681e379db5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.847125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a314dd7-ac32-4d92-a106-a4681e379db5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.847177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a314dd7-ac32-4d92-a106-a4681e379db5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.847311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a314dd7-ac32-4d92-a106-a4681e379db5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.847392] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a314dd7-ac32-4d92-a106-a4681e379db5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.894471] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d904f37a-b3f7-4aef-9721-265081cb343b: rpc.has_security_group_logging(os_id): False [ 883.912025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.912025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.912025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.912025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.913252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.916539] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.916539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.916539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.916539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.916539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.916539] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 883.974332] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.974667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.974667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.975264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.975264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.986626] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 884.349012] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.350171] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.350171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.350360] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a314dd7-ac32-4d92-a106-a4681e379db5 with status ACTIVE [ 884.350543] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.350646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.350696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.350873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.350962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.351152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.351285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.351341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.351454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.351531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.351712] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.351800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.351855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.352015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.352231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.352405] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a314dd7-ac32-4d92-a106-a4681e379db5 is going to be updated. [ 884.371521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.371773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.371898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.372359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.372359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.372462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a314dd7-ac32-4d92-a106-a4681e379db5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.801026] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 in Status: SUCCESS [ 884.801259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.801426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.801651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.801845] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.801963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.802053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.802230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.802505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.802588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.802692] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.854643] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.305581] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.306027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.306027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.306117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.306309] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.306404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.306471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.306658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.306798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.306960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.307176] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.307303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.307390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.307543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.307700] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.307795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.307858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.308029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.308237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.308326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.308418] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.357135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.357297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.357362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.357584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.357683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.357787] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a is going to be created. [ 885.379301] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.379509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.379509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.379726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.379905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.388996] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a in Status: UNINITIALIZED for 2s [ 885.816853] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9b439f6-daaf-4792-b3c7-d618e26ce5f4: rpc.has_security_group_logging(os_id): False [ 885.834093] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.834093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.834093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.834093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.834093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.834381] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.834381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.834530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.834622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.834677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.834876] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.834971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.835068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.835224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.835302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.835497] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.835593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.835668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.835808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.835881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.835969] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 is going to be created. [ 885.901772] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.901772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.901772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.901772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.901772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.918158] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 in Status: IN_PROGRESS for 2s [ 886.002113] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 886.002358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.082233] env[69358]: INFO networking_nsxv3.common.synchronization [req-af113c14-0f4e-48a8-8373-120fa11fa3a6 req-7dec3010-4fcf-4bdb-9920-c6530da6f13d tempest-ServerGroupTestJSON-560475170 tempest-ServerGroupTestJSON-560475170-project-member] Enqueued Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGHEST for action security_group_members [ 887.082778] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGHEST for action security_group_members [ 887.083606] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af2cb3a-4662-4499-98ee-9085e996828e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.083774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.083774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.084023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.084195] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.084305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.084384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.084511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.084592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.084687] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.400673] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a in Status: SUCCESS [ 887.400896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.401075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.401297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.401521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.401646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.401711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.401886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.401962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.402078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.402167] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.586441] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.586659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.586703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.587368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.587368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.587368] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.587663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.587663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.587663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.587757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.587789] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af2cb3a-4662-4499-98ee-9085e996828e is going to be updated. [ 887.616401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.616401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.616401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.616401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.616401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.624271] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af2cb3a-4662-4499-98ee-9085e996828e in Status: IN_PROGRESS for 2s [ 887.904346] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.904539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.904592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.904797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.905030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.905145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.905194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.905314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.905402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.905496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.905692] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.905767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.905831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.905949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.906114] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.906205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.906205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.906357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.906415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.906496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.906620] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.929721] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 in Status: SUCCESS [ 887.929721] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.409337] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a: rpc.has_security_group_logging(os_id): False [ 888.429337] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.429550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.429647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.429869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.429968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.430231] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.430351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.430416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.430591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.430720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.430938] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.431058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.431171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.431320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.431396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.431619] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.431781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.431842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.431989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.432074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.432188] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a is going to be created. [ 888.486313] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.486467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.486520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.486769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.487192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.496152] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a in Status: IN_PROGRESS for 2s [ 889.633956] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af2cb3a-4662-4499-98ee-9085e996828e in Status: SUCCESS [ 889.633956] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af2cb3a-4662-4499-98ee-9085e996828e deletion is rescheduled due to dependency. [ 889.633956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.508517] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a in Status: SUCCESS [ 890.508517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.687554] env[69358]: INFO networking_nsxv3.common.synchronization [req-aa7e6c02-a097-47d2-87ff-fc6afdc3081f req-c2d4a2d2-5c0a-409f-8d68-bfcb04426ee2 tempest-FloatingIPsAssociationTestJSON-1066125890 tempest-FloatingIPsAssociationTestJSON-1066125890-project-member] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 891.688092] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGHEST for action security_group_members [ 891.688399] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.688526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.688601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.688780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.688938] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.691768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.691886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.692124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.692223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.692323] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.196537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.196744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.196809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.197092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.197244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.197462] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.197587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.197664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.197860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.197942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.198039] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e4e649-079d-4cd0-98f4-699005461275 is going to be updated. [ 892.225566] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.225566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.225566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.225566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.225566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.232283] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: IN_PROGRESS for 2s [ 893.170020] env[69358]: INFO networking_nsxv3.common.synchronization [req-ed8b8e09-6521-4182-89ab-ef89a438f40d req-fdedc429-ab88-481a-bf21-76bae8e45f11 tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 893.170628] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 893.170884] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.171010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.171084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.171281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.171424] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.171519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.171580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.171763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.171838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.171873] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.570917] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.571252] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.571417] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.571752] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.572129] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.573156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.573156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.573156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.573156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.573156] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.573579] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.573579] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.573579] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.573683] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.573769] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.573883] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.592371] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.592541] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 893.592644] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.592789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.593196] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-2912f46a-cc9f-4459-85c3-408886060094 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.593405] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-2912f46a-cc9f-4459-85c3-408886060094" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.593487] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-2912f46a-cc9f-4459-85c3-408886060094" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.594258] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-2912f46a-cc9f-4459-85c3-408886060094" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.594490] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2912f46a-cc9f-4459-85c3-408886060094',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.676009] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.676009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.676009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.676009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.676009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.676009] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.676009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.676009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.676009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.676009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.676009] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 893.699958] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.699958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.699958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.699958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.699958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.707913] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 894.097375] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.097594] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.097735] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.098046] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.098217] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.098394] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 2912f46a-cc9f-4459-85c3-408886060094 not found, creating... [ 894.098722] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.098902] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.099037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.099307] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.099510] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.099850] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.100042] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.100177] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.100417] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.100588] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.100746] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 2912f46a-cc9f-4459-85c3-408886060094 is going to be created. [ 894.120176] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.120346] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.120446] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.120714] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.120951] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.121282] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-2912f46a-cc9f-4459-85c3-408886060094" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.205560] env[69358]: INFO networking_nsxv3.common.synchronization [req-cba48186-18a5-415a-9de5-f60ca521f5b9 req-beb1b953-79a8-43f0-91df-d4365495e5cb tempest-ServerDiagnosticsTest-1847944580 tempest-ServerDiagnosticsTest-1847944580-project-member] Enqueued Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGHEST for action security_group_members [ 894.207059] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGHEST for action security_group_members [ 894.207059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.207059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.207059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.207059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.207059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.207059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.208974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.209187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.209285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.209386] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.244031] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e4e649-079d-4cd0-98f4-699005461275 in Status: SUCCESS [ 894.244031] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e4e649-079d-4cd0-98f4-699005461275 deletion is rescheduled due to dependency. [ 894.244031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.711343] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.711695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.711766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.711956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.712056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.712276] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.712382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.712444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.712590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.712663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.712746] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 is going to be updated. [ 894.738139] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.738280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.738353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.738546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.738684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.747682] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 in Status: IN_PROGRESS for 2s [ 894.850439] env[69358]: INFO networking_nsxv3.common.synchronization [req-ed8b8e09-6521-4182-89ab-ef89a438f40d req-ce27bc44-0df9-45ce-ab4a-fd27bdbc9ecb service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 894.850615] env[69358]: INFO networking_nsxv3.common.synchronization [req-ed8b8e09-6521-4182-89ab-ef89a438f40d req-ce27bc44-0df9-45ce-ab4a-fd27bdbc9ecb service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 894.850751] env[69358]: INFO networking_nsxv3.common.synchronization [req-ed8b8e09-6521-4182-89ab-ef89a438f40d req-ce27bc44-0df9-45ce-ab4a-fd27bdbc9ecb service nova] Enqueued Resource ID: 2912f46a-cc9f-4459-85c3-408886060094 with Priority: HIGHEST for action port [ 894.850985] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 894.851158] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 894.851287] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2912f46a-cc9f-4459-85c3-408886060094 with Priority: HIGHEST for action port [ 894.851801] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.851922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.851991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.853092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.853187] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.854135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.854208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.854374] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-2912f46a-cc9f-4459-85c3-408886060094 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.854478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2912f46a-cc9f-4459-85c3-408886060094" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.854543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2912f46a-cc9f-4459-85c3-408886060094" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.854714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2912f46a-cc9f-4459-85c3-408886060094" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.854789] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2912f46a-cc9f-4459-85c3-408886060094',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.356823] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.357293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.360406] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2912f46a-cc9f-4459-85c3-408886060094 with status ACTIVE [ 895.362078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.362078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.362078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.362078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.362744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.362744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.362744] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2912f46a-cc9f-4459-85c3-408886060094 is going to be updated. [ 895.383287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.383526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.383625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.383943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.384166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.384388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2912f46a-cc9f-4459-85c3-408886060094" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.718109] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 895.718345] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 deletion is rescheduled due to dependency. [ 895.718916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.719158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.719394] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.719595] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.719727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.719795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.719992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.720076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.720606] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.916317] env[69358]: INFO networking_nsxv3.common.synchronization [req-15a605ef-98ca-478e-bb09-659f8d30a069 req-ef98d913-97bd-488f-92de-caf7a4232558 tempest-InstanceActionsTestJSON-2103089501 tempest-InstanceActionsTestJSON-2103089501-project-member] Enqueued Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGHEST for action security_group_members [ 895.916317] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGHEST for action security_group_members [ 895.916317] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-20029fd2-1ece-44e8-95e9-efcf32b1a108 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.916317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.916317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.916317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.916652] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.916652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.916652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.916830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.916869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.917752] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.222951] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.328965] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.333020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-811" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.333020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-811" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.333020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-811" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.333020] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.333020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.333020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.333020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.333020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.333020] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.333020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.333020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.333020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.333020] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.333020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.333020] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.349383] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.349383] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 896.349532] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.349795] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-811" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.350104] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-337b1289-769f-4480-bb99-7e07f40e1688 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.350328] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-337b1289-769f-4480-bb99-7e07f40e1688" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.350455] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-337b1289-769f-4480-bb99-7e07f40e1688" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.350810] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-337b1289-769f-4480-bb99-7e07f40e1688" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.351335] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('337b1289-769f-4480-bb99-7e07f40e1688',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.419401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.419735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.419735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.419874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.419947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.420181] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.420291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.420347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.420501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.420583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.420751] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 already deleted. [ 896.421193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.723960] env[69358]: INFO networking_nsxv3.common.synchronization [req-5365ab0e-e9a2-48a5-b8c0-2062f2a736ff req-fc6fd989-63fb-45fc-bcb5-57bddc5914f5 tempest-ServerMetadataNegativeTestJSON-235946287 tempest-ServerMetadataNegativeTestJSON-235946287-project-member] Enqueued Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGHEST for action security_group_members [ 896.724650] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGHEST for action security_group_members [ 896.724983] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.725994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.726371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.726505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.726718] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.727860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.728009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.728246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.728386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.728544] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.729502] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.757804] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 in Status: SUCCESS [ 896.757804] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 deletion is rescheduled due to dependency. [ 896.757997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.854118] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.854386] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.854520] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.854803] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.854955] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.855129] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 337b1289-769f-4480-bb99-7e07f40e1688 not found, creating... [ 896.855406] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.855570] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.855703] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.855927] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.856078] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.856361] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.856517] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.856636] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.856844] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.856979] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.857131] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 337b1289-769f-4480-bb99-7e07f40e1688 is going to be created. [ 896.876827] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.877047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.877176] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.877437] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.877661] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.877886] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-337b1289-769f-4480-bb99-7e07f40e1688" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.232706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.232706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.232706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.232706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.232706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.232706] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 897.233999] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.234112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.234203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.234411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.234515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.234696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.234811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.234875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.235032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.235111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.235198] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a is going to be updated. [ 897.267328] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.267328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.267328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.267328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.267328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.269472] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.269472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.269472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.269656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.269656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.282768] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a in Status: IN_PROGRESS for 2s [ 897.283539] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 897.586782] env[69358]: INFO networking_nsxv3.common.synchronization [req-15a605ef-98ca-478e-bb09-659f8d30a069 req-2d57a0ab-b934-4243-9a5f-4ab2aaf30c9c service nova] Enqueued Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGHEST for action security_group_rules [ 897.587055] env[69358]: INFO networking_nsxv3.common.synchronization [req-15a605ef-98ca-478e-bb09-659f8d30a069 req-2d57a0ab-b934-4243-9a5f-4ab2aaf30c9c service nova] Enqueued Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGHEST for action security_group_members [ 897.587181] env[69358]: INFO networking_nsxv3.common.synchronization [req-15a605ef-98ca-478e-bb09-659f8d30a069 req-2d57a0ab-b934-4243-9a5f-4ab2aaf30c9c service nova] Enqueued Resource ID: 337b1289-769f-4480-bb99-7e07f40e1688 with Priority: HIGHEST for action port [ 897.588432] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGHEST for action security_group_rules [ 897.588432] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGHEST for action security_group_members [ 897.588432] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 337b1289-769f-4480-bb99-7e07f40e1688 with Priority: HIGHEST for action port [ 897.588432] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20029fd2-1ece-44e8-95e9-efcf32b1a108 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.588432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.588432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.588756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.588756] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.590140] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-20029fd2-1ece-44e8-95e9-efcf32b1a108 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.590277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.590347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.590523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.590733] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.590810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.590846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.590970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.591090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.591184] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.592250] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-337b1289-769f-4480-bb99-7e07f40e1688 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.592406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-337b1289-769f-4480-bb99-7e07f40e1688" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.592406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-337b1289-769f-4480-bb99-7e07f40e1688" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.592565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-337b1289-769f-4480-bb99-7e07f40e1688" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.592684] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('337b1289-769f-4480-bb99-7e07f40e1688',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.095431] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-20029fd2-1ece-44e8-95e9-efcf32b1a108 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.095431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.095431] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.096197] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 337b1289-769f-4480-bb99-7e07f40e1688 with status ACTIVE [ 898.096531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.100169] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.100169] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.100169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.100169] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 337b1289-769f-4480-bb99-7e07f40e1688 is going to be updated. [ 898.118202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.118394] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.118470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.118871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.118978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.119203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-337b1289-769f-4480-bb99-7e07f40e1688" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.596952] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.100558] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.100802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.100907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.101247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.101526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.101743] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 is going to be created. [ 899.124605] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.124754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.124794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.125043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.125216] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.133668] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 in Status: UNINITIALIZED for 2s [ 899.293758] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 899.293985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.294170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.294424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.294622] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.294744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.294888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.295096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.295187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.295297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.295386] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.297277] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a in Status: SUCCESS [ 899.297479] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a deletion is rescheduled due to dependency. [ 899.297577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.804571] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.804894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.804894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.805039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.805286] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.805440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.805532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.805740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.805863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.805975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.806166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.806302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.806483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.806550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.806686] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.806783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.806848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.806993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.807081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.807150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.807241] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.310080] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e45a41dd-b21d-4639-af89-ce7883a3d987: rpc.has_security_group_logging(os_id): False [ 900.329597] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.329818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.329818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.330037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.330124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.330360] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.330429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.330480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.330617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.330697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.330892] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.330986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.331067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.331211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.331287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.331479] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.331567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.331630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.331767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.331841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.331926] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 900.387995] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.388164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.388237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.388468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.388638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.399802] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 900.474027] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.474201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.474300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.474558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.474692] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.977781] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.143392] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 in Status: UNINITIALIZED for 4s [ 901.482452] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.988598] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 901.988861] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 902.413022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 902.413222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.588938] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 902.588938] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 902.832713] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.832873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.832951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.833192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.844522] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 902.847495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.847917] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 902.877074] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.877365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.877365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.877546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.883946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.884976] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 902.885159] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 902.885428] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 902.921798] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.921798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.921798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.921798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.923327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.923613] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 902.980470] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.982385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.982385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.982794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.983342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.983772] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 903.045194] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.045697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.045697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.045697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.046244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.047395] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 903.047395] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1ab11f00-3987-4b05-b006-d9576475f847', '38b21152-b672-43d0-bb12-4ff761d0e3a8', 'e45a41dd-b21d-4639-af89-ce7883a3d987', '689199c8-8cdd-4299-865b-276e93b23c6b', '5c2d1cb5-beda-4718-964c-8cbc07452049', 'cb1dcd4d-bf87-416a-a453-7eff939b6bce', 'f55e4213-4f47-44ae-b8e8-d46185e8161b', 'fe03fb7c-5cc5-4d19-acba-b32df8b792f2', '1af2cb3a-4662-4499-98ee-9085e996828e', 'd5fcd8c7-88e6-4977-80ed-2cb4e6758bc9', 'f22bfa82-0766-4940-b70e-28b7b023248e', 'ac4d32ff-0296-4f24-a97d-f033779cef5a', '399e5b2f-147f-4c05-b525-1c92b4bd694d', '908f61ef-0a88-4419-a8be-58a9e18a05ea', '7badac2d-7352-4331-adc3-4bc4f3b30231', 'a6825e81-3f64-4e7b-908b-47b35fcde1e2', 'ad2fd29d-e8c3-4394-a485-44391d15526c', '1fd0a41a-dc8b-4e27-9e8b-ab70875e649a', '458cc6cf-d8de-4e92-b69d-a92c283ddbaa', 'e0f3175f-70d6-4954-936f-524f7ca25a4b', 'a63445e5-d5fa-4b5f-aefd-36f6c4ad7252', 'b8ab349f-7df0-40a9-a595-1a8e298f956a', '0e7da1ca-32ca-4463-86e0-e62b1a908a4a', '9495602c-f01c-4935-941b-dacd2d1ea667', 'e9b439f6-daaf-4792-b3c7-d618e26ce5f4', 'd18a7451-b9c3-48be-82ef-e20729d3779a', 'd904f37a-b3f7-4aef-9721-265081cb343b', '32d20126-9c39-42b2-acda-4aa519da54c6', 'a1e4e649-079d-4cd0-98f4-699005461275', '46002bc2-9685-44d1-a0f5-f9a4ebc7e375', 'b755d42e-d250-4f75-9179-3ef054a079c6', '98a5293d-e48e-493b-ac38-3a76cc74a5db', 'fd2c3b18-33a0-460a-a199-3124440c68e8', '3790264b-87dd-4660-b7c5-8d4dc98f1500'} {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 903.048461] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 903.066697] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.066857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.066933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.067171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.067254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.067360] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 903.067429] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 903.067498] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 903.126293] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.126438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.126541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.126712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.127396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.129330] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 903.129330] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 903.129330] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 903.129330] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 903.129330] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGH for action security_group_rules [ 903.129330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.153564] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 in Status: SUCCESS [ 903.153564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.153564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.153728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.153846] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.153958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.154043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.154186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.154653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.154653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.154653] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.658446] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-20029fd2-1ece-44e8-95e9-efcf32b1a108 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.658661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.658772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.659110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.659347] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.659558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.659744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.659943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.660048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.660142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.660304] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-20029fd2-1ece-44e8-95e9-efcf32b1a108 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.660403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.660465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.660613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.660752] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.660841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.660898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.661199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.661298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.661391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.661485] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.163954] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20029fd2-1ece-44e8-95e9-efcf32b1a108: rpc.has_security_group_logging(os_id): False [ 904.183841] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.183841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.183841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.183841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.183841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.183841] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.183841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.183841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.183841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.183841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.184260] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.184260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.184260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.184423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.184559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.184724] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.184834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.184904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.185125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.185228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.185351] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 is going to be created. [ 904.240067] env[69358]: INFO networking_nsxv3.common.synchronization [None req-9e81dd51-395d-47df-8c9d-ec96f9d8a9e5 tempest-ServerRescueNegativeTestJSON-1118501628 tempest-ServerRescueNegativeTestJSON-1118501628-project-member] Enqueued Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_rules [ 904.246706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.246854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.246931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.247358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.247549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.249032] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_rules [ 904.249194] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGH for action security_group_rules [ 904.249307] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGH for action security_group_rules [ 904.249407] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGH for action security_group_rules [ 904.249505] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGH for action security_group_rules [ 904.249600] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGH for action security_group_rules [ 904.249692] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa with Priority: HIGH for action security_group_rules [ 904.249782] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a with Priority: HIGH for action security_group_rules [ 904.253452] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2fd29d-e8c3-4394-a485-44391d15526c with Priority: HIGH for action security_group_rules [ 904.253565] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea with Priority: HIGH for action security_group_rules [ 904.253705] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGH for action security_group_rules [ 904.253829] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d with Priority: HIGH for action security_group_rules [ 904.253929] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4d32ff-0296-4f24-a97d-f033779cef5a with Priority: HIGH for action security_group_rules [ 904.254034] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGH for action security_group_rules [ 904.254124] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 with Priority: HIGH for action security_group_rules [ 904.254220] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af2cb3a-4662-4499-98ee-9085e996828e with Priority: HIGH for action security_group_rules [ 904.255074] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce with Priority: HIGH for action security_group_rules [ 904.255074] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 with Priority: HIGH for action security_group_rules [ 904.255074] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGH for action security_group_rules [ 904.255074] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGH for action security_group_rules [ 904.255074] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGH for action security_group_rules [ 904.255273] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.255351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.256125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.256125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.256125] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.257324] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.257324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.257324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.257696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.257696] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.258853] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.258989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.259073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.259290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.259380] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.260226] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.260339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.260407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.260568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.260637] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.267107] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.267107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.267107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.267107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.267107] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.268683] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.268683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.268683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.268683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.268683] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.269738] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.269738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.269738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.269921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.269970] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('458cc6cf-d8de-4e92-b69d-a92c283ddbaa',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.271990] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.271990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.271990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.271990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.271990] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fd0a41a-dc8b-4e27-9e8b-ab70875e649a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.273941] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2fd29d-e8c3-4394-a485-44391d15526c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.273941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.273941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.273941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.273941] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2fd29d-e8c3-4394-a485-44391d15526c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.275765] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-908f61ef-0a88-4419-a8be-58a9e18a05ea taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.275765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.275765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.275765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.275765] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('908f61ef-0a88-4419-a8be-58a9e18a05ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.275765] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.276031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.276031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.276031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.276219] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.276355] env[69358]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 904.277083] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-399e5b2f-147f-4c05-b525-1c92b4bd694d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.277872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.277872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.277872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.277872] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('399e5b2f-147f-4c05-b525-1c92b4bd694d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.278555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4d32ff-0296-4f24-a97d-f033779cef5a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.278662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.278730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.278866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.278933] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4d32ff-0296-4f24-a97d-f033779cef5a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.279806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.279922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.279973] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.280123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.280198] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.281360] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.281360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.281360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.282598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.282598] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.282598] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1af2cb3a-4662-4499-98ee-9085e996828e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.283667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.283667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.283667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.283667] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1af2cb3a-4662-4499-98ee-9085e996828e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.283788] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.285335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.288197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.288451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.288588] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1dcd4d-bf87-416a-a453-7eff939b6bce',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.289820] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.289820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.289946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.290197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.290308] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe03fb7c-5cc5-4d19-acba-b32df8b792f2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.292435] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.292582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.292657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.292832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.292912] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.296068] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.296241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.296330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.296558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.296664] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.298092] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.298201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.298270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.298497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.298607] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.298946] env[69358]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 904.306367] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.306775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.306775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.306902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.307152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.307709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.307709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.307709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.307709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.307915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.307970] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.330300] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 in Status: IN_PROGRESS for 2s [ 904.336438] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.336781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.336781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.337056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.337189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.337335] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 already deleted. [ 904.337470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.352538] env[69358]: INFO networking_nsxv3.common.synchronization [None req-b7a4b671-4d2f-4382-9865-04efb86b1eb5 tempest-ServerRescueNegativeTestJSON-1118501628 tempest-ServerRescueNegativeTestJSON-1118501628-project-member] Enqueued Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_rules [ 904.356407] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_rules [ 904.359819] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.360155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.360155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.360475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.360608] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.731295] env[69358]: INFO networking_nsxv3.common.synchronization [req-1a375779-b906-49c3-b07c-61453492c25e req-db58a839-12e7-4ac8-a3ad-3e7773fc710a tempest-ServersTestBootFromVolume-1590001012 tempest-ServersTestBootFromVolume-1590001012-project-member] Enqueued Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_members [ 904.731839] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_members [ 904.732156] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6990b0-078a-4815-9003-99ea585a4222 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.732288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.732339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.732583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.732734] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.732824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.732886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.733036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.733114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.733205] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.802675] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.802841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.805017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.805017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.805017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.805017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.805017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.805017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.805017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.805017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.805017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.814440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.814440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.814440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.814809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.814809] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.814912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.814975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.815154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.815273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.815340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.815524] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.815622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.815684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.815827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.815969] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.816078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.816141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.816293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.816373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.816458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.816552] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.868041] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.868041] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.868041] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.868041] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.868041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.868978] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.869240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.869411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.869671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.869863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.870044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.870229] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.876958] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.877300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.877523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.877821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.878220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.878457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.878604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.880946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.880946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.880946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.880946] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.885528] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.885893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.886072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.886450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.898703] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.898913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.898994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.899266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.899492] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.899589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.899670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.899871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.903018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.903177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.903347] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.904550] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.904695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.904759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.904944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.905117] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.905244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.905367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.906022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.906022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.906022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.906022] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.909964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.910143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.910284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.910431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.910560] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.911868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.911868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.911868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.911868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.911868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.911868] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.951051] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.951237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.952404] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.952541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.954381] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.954501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.955521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.955632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.956499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.956614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.957813] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.957912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.959120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.959289] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 458cc6cf-d8de-4e92-b69d-a92c283ddbaa is going to be deleted. [ 904.960234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.960454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.962397] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.962397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.963278] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.963365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.964303] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.964489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.965861] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.966047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.967186] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.967350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.969715] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 904.969979] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.970152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.982230] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 904.983141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.983320] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be deleted. [ 904.984455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.984736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.001486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.001640] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4d32ff-0296-4f24-a97d-f033779cef5a is going to be deleted. [ 905.006030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.006030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.015568] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.015568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.019834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.020156] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1af2cb3a-4662-4499-98ee-9085e996828e is going to be deleted. [ 905.021702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.021949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.044305] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.044305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.045739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.045935] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be deleted. [ 905.046923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.047165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.084186] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.084435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.092636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.092770] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9 is going to be deleted. [ 905.093774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.094011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.131908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.132096] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1dcd4d-bf87-416a-a453-7eff939b6bce is going to be deleted. [ 905.135545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.135545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.136545] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.136670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.177430] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.177819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.178400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.181020] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2fd29d-e8c3-4394-a485-44391d15526c is going to be deleted. [ 905.181020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.181020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.181187] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.181263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.237082] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-486 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.237082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-486" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.237082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-486" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.237082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-486" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.237082] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.237082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.237082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.237082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.237082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.237082] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.237082] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.237082] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.237082] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.237468] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.237468] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.237468] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.238634] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.238745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.256241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.256387] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fd0a41a-dc8b-4e27-9e8b-ab70875e649a is going to be deleted. [ 905.257275] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.257478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.257566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.257660] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 already deleted. [ 905.257744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.257956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.258055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.307081] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.307271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.307599] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.307735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.307825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.308476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.308655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.308762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.308830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.309023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.309117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.309226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.309378] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.309488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.309551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.309701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.309838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.309929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.310095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.310150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.310244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.310633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.310740] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.318344] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.318514] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.081 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 905.318658] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.318836] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-486" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.319202] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e09d68df-29b0-416b-ae4d-40def002b979 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.319510] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e09d68df-29b0-416b-ae4d-40def002b979" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.319673] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e09d68df-29b0-416b-ae4d-40def002b979" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.320051] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e09d68df-29b0-416b-ae4d-40def002b979" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.320226] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e09d68df-29b0-416b-ae4d-40def002b979',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.321120] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 905.329331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.329824] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 399e5b2f-147f-4c05-b525-1c92b4bd694d is going to be deleted. [ 905.331074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.331374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.348433] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.348433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.361029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.361029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 908f61ef-0a88-4419-a8be-58a9e18a05ea is going to be deleted. [ 905.361029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.361029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.368212] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.368324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.389715] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.389967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.390057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.390279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.390449] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.390543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.390603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.391016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.391016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.391016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.391123] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.391167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.391213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.391369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.391620] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.391734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.391853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.391934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.392019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.392099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.392501] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.394857] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.396134] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.400024] env[69358]: INFO networking_nsxv3.common.synchronization [req-103f1b22-ee18-4296-ad04-619986d5603a req-d0c84a49-67a7-42d2-a811-fd9f59b2deda tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 905.400024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.400024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.400024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.400024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe03fb7c-5cc5-4d19-acba-b32df8b792f2 is going to be deleted. [ 905.401795] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 905.402049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.402347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.402508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.402718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-458cc6cf-d8de-4e92-b69d-a92c283ddbaa" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.403117] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.403472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.403606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.403872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.405030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.405030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.405030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.405030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.405030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.405030] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.405976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.406210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.406349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.406532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.408975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.409327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.410187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.410187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4d32ff-0296-4f24-a97d-f033779cef5a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.410364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.410486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.411058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.411058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1af2cb3a-4662-4499-98ee-9085e996828e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.411978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.412241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.413165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.413165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.413876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.414137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.414225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.414414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5fcd8c7-88e6-4977-80ed-2cb4e6758bc9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.416383] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.419294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.419294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.419294] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.419294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.419294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.419294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.419294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.419294] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6990b0-078a-4815-9003-99ea585a4222 already deleted. [ 905.419294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.419705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.419781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.419849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.420028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.420191] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.420292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.420357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.420497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.420574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.420655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.421185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.421307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.421363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.421537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.421701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.421810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.421871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.422016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.422093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.422176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.422269] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.423424] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.423527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.423669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.423776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.423935] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.424077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.424116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.424237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.424318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.424600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.424600] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.424668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.424720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.424856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.424991] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.425092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.425187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.425277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.425365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.425589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.425589] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.426280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.426443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.426528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.426650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2fd29d-e8c3-4394-a485-44391d15526c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.427787] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.427932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.428013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.428203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.428359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.428473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.428548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.428813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.428813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.428887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.429042] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.429153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.429235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.429394] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.429531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.429646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.429716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.429852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.429938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.430035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.430131] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.432505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.432797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.432848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.432990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1dcd4d-bf87-416a-a453-7eff939b6bce" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.433471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.433640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.494703] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.494841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.496174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.496408] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.496560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.496604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.496813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.496935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.497097] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.497193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.497321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.497421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.497469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.497668] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.497748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.497804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.497939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.498022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.498161] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 905.499668] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.499821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.499821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.499970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.500061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.500165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-399e5b2f-147f-4c05-b525-1c92b4bd694d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.500308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.500451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.500526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.500628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fd0a41a-dc8b-4e27-9e8b-ab70875e649a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.500750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.500888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.500964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.501096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-908f61ef-0a88-4419-a8be-58a9e18a05ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.547392] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.547581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.548406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.548406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.548406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.548406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe03fb7c-5cc5-4d19-acba-b32df8b792f2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.592085] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 905.592760] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.592868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.592951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.593334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.593399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.694443] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 905.815707] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e45a41dd-b21d-4639-af89-ce7883a3d987: rpc.has_security_group_logging(os_id): False [ 905.824040] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.824040] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.824040] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.824756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.824756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.825453] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e09d68df-29b0-416b-ae4d-40def002b979 not found, creating... [ 905.825453] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.825635] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.825721] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.825922] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.826257] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.826635] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.827315] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.827315] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.827315] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.827485] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.827681] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e09d68df-29b0-416b-ae4d-40def002b979 is going to be created. [ 905.845649] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.845813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.845813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.845986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.852264] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.852506] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.853920] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.853920] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.853920] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.853920] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e09d68df-29b0-416b-ae4d-40def002b979" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.873805] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.874095] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.874280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.874416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.874577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.874667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.874898] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.875074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.875191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.875326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.875429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.875633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.875794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.875794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.875960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.876041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.876112] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 905.901225] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f22bfa82-0766-4940-b70e-28b7b023248e: rpc.has_security_group_logging(os_id): False [ 905.901225] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7badac2d-7352-4331-adc3-4bc4f3b30231: rpc.has_security_group_logging(os_id): False [ 905.901805] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0f3175f-70d6-4954-936f-524f7ca25a4b: rpc.has_security_group_logging(os_id): False [ 905.908179] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.908179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.908179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.909684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.933541] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.933739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.934024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38b21152-b672-43d0-bb12-4ff761d0e3a8: rpc.has_security_group_logging(os_id): False [ 905.935789] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c2d1cb5-beda-4718-964c-8cbc07452049: rpc.has_security_group_logging(os_id): False [ 905.936365] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6825e81-3f64-4e7b-908b-47b35fcde1e2: rpc.has_security_group_logging(os_id): False [ 905.938285] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.938402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.939430] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.939430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.941349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.941585] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.941771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.941842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.944444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.944444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.944444] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 905.944444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.944444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.965863] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.965863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.966605] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.968455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.978040] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.978040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.010094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.010094] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.010094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.010094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.010094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.010094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.010401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.010401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.010474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.010609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.010683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.010862] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.010944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.010994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.011189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.011278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.011372] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be updated. [ 906.012829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.012996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.046768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.046768] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.046905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.046905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.047133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.047246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.047352] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 is going to be updated. [ 906.049012] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.049012] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.050889] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.051037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.051094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.051299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.051460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.054326] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.054479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.075812] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 906.088618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.089009] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.089204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.089339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.089588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.089815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.090156] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.090624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.090624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.090749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.090835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.091075] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.091208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.091288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.091447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.091573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.091681] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 906.092829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.092996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.126437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.126850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.127015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.127110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.127342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.127457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.127688] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.127818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.127891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.128091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.128182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.128418] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.128531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.128585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.128740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.128815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.128911] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be updated. [ 906.130073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.130236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.166166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.166166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.174465] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.174628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.185063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.185399] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.185399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.185502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.185617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.185729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.185897] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.185981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.186073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.186214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.186382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.186459] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.186540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.186601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.186787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.186848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.186955] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be updated. [ 906.188687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.188875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.213070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.213402] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.213531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.213583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.213767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.213847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.213940] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 906.215028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.215418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.215569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.216867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.217204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.218245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.218373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.218869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.218869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.254206] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: IN_PROGRESS for 2s [ 906.255258] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 906.256196] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.256332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.256400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.256613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.256756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.268842] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.269016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.269088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.269297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.269438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.271408] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 in Status: IN_PROGRESS for 2s [ 906.287468] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: IN_PROGRESS for 2s [ 906.288944] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 906.346870] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.347148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.347256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.347496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.347827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.349531] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 in Status: SUCCESS [ 906.349866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.364530] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.364685] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.364801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.364962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.365181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.380014] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 906.385962] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: IN_PROGRESS for 2s [ 906.567815] env[69358]: INFO networking_nsxv3.common.synchronization [req-1a375779-b906-49c3-b07c-61453492c25e req-6018d7c3-a21b-4710-9bd6-93694f590908 service nova] Enqueued Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_rules [ 906.568053] env[69358]: INFO networking_nsxv3.common.synchronization [req-1a375779-b906-49c3-b07c-61453492c25e req-6018d7c3-a21b-4710-9bd6-93694f590908 service nova] Enqueued Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_members [ 906.568229] env[69358]: INFO networking_nsxv3.common.synchronization [req-1a375779-b906-49c3-b07c-61453492c25e req-6018d7c3-a21b-4710-9bd6-93694f590908 service nova] Enqueued Resource ID: e09d68df-29b0-416b-ae4d-40def002b979 with Priority: HIGHEST for action port [ 906.568778] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_rules [ 906.568942] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_members [ 906.569069] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09d68df-29b0-416b-ae4d-40def002b979 with Priority: HIGHEST for action port [ 906.571839] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca6990b0-078a-4815-9003-99ea585a4222 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.571839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.571839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.571839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.571839] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.571839] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6990b0-078a-4815-9003-99ea585a4222 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.571839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.571839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.572325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.572325] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.572325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.572325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.572688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.572803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.573094] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.573725] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e09d68df-29b0-416b-ae4d-40def002b979 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.574464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e09d68df-29b0-416b-ae4d-40def002b979" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.574464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e09d68df-29b0-416b-ae4d-40def002b979" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.574464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e09d68df-29b0-416b-ae4d-40def002b979" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.574464] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e09d68df-29b0-416b-ae4d-40def002b979',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.075744] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6990b0-078a-4815-9003-99ea585a4222 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.075910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.076152] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.077445] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e09d68df-29b0-416b-ae4d-40def002b979 with status ACTIVE [ 907.077655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.077779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.077854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.079032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.079128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.079370] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.079471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.079565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.079756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.079862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.080069] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.080174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.080225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.080359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.080430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.080510] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e09d68df-29b0-416b-ae4d-40def002b979 is going to be updated. [ 907.100585] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.100752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.100821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.101069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.101216] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.101387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e09d68df-29b0-416b-ae4d-40def002b979" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.582666] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.711535] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 907.711535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.086674] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 908.086804] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 908.086923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.088202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.088202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.088202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.088202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.088202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.088202] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6990b0-078a-4815-9003-99ea585a4222 is going to be created. [ 908.109611] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.109928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.109928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.110099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.110175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.119700] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6990b0-078a-4815-9003-99ea585a4222 in Status: UNINITIALIZED for 2s [ 908.269948] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: SUCCESS [ 908.270192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.271042] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 908.271231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.283169] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 in Status: SUCCESS [ 908.283425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.298321] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: SUCCESS [ 908.298525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.299635] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 908.299813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.394352] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 908.394654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.398735] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: SUCCESS [ 908.398735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.131367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6990b0-078a-4815-9003-99ea585a4222 in Status: SUCCESS [ 910.131655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.133155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.135217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.135217] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.135217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.135217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.135217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.135217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.135217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.135217] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.638371] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.142032] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca6990b0-078a-4815-9003-99ea585a4222: rpc.has_security_group_logging(os_id): False [ 911.158885] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.159126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.159241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.159550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.159661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.159932] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.160069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.160137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.160303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.160380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.160509] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca6990b0-078a-4815-9003-99ea585a4222 is going to be created. [ 911.214785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.215167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.215249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.215587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.215820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.226191] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca6990b0-078a-4815-9003-99ea585a4222 in Status: IN_PROGRESS for 2s [ 911.570304] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 911.570463] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 912.294514] env[69358]: INFO networking_nsxv3.common.synchronization [req-0d6b097b-5c36-431d-bbbd-5d0387d3ac99 req-716eea12-7d03-4ded-b357-df26b9382704 tempest-ServersAdminTestJSON-846589263 tempest-ServersAdminTestJSON-846589263-project-member] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 912.295321] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 912.295704] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.295860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.295929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.296194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.296538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.296538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.296652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.296792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.296831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.296938] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.614633] env[69358]: INFO networking_nsxv3.common.synchronization [req-3b1ad5a9-b4fd-4112-a6f3-d8864d0abc68 req-0ecbc662-9bde-4350-a2da-4ee275e1e8ee tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 912.615320] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 912.615661] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.615792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.615868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.616073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.616249] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.616351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.616398] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.616542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.616626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.616719] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.799564] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.002549] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.002778] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.002913] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.003226] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.003487] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.003945] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.004127] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.004359] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.004572] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.004816] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.004935] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.005057] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.005170] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.005288] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.005395] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.005643] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.027198] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.027395] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 913.027553] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.027756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.028119] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-c3ab3b95-ba47-476a-8431-38016deb9c1a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.028311] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-c3ab3b95-ba47-476a-8431-38016deb9c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.028437] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-c3ab3b95-ba47-476a-8431-38016deb9c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.028805] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-c3ab3b95-ba47-476a-8431-38016deb9c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.028946] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ab3b95-ba47-476a-8431-38016deb9c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.118939] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.237421] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca6990b0-078a-4815-9003-99ea585a4222 in Status: SUCCESS [ 913.238117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.303683] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.531366] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.532376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.532376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.532376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.532769] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.533062] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port c3ab3b95-ba47-476a-8431-38016deb9c1a not found, creating... [ 913.533380] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.533564] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.533692] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.533984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.534136] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.534460] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.534707] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.534970] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.535374] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.535374] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.535478] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: c3ab3b95-ba47-476a-8431-38016deb9c1a is going to be created. [ 913.556736] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.556964] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.557122] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.557482] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.557758] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.558063] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-c3ab3b95-ba47-476a-8431-38016deb9c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.622284] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.806539] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.806698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.806772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.807108] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.807229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.807334] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 913.837672] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.837672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.837672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.837915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.837915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.846450] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 914.124967] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.125141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.125179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.125435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.125549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.125677] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 914.152762] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.152978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.153040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.153351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.153400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.162081] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 914.349285] env[69358]: INFO networking_nsxv3.common.synchronization [req-3b1ad5a9-b4fd-4112-a6f3-d8864d0abc68 req-66baa011-93e1-4a3f-8f81-5e9fe5d8d374 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 914.349285] env[69358]: INFO networking_nsxv3.common.synchronization [req-3b1ad5a9-b4fd-4112-a6f3-d8864d0abc68 req-66baa011-93e1-4a3f-8f81-5e9fe5d8d374 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 914.349285] env[69358]: INFO networking_nsxv3.common.synchronization [req-3b1ad5a9-b4fd-4112-a6f3-d8864d0abc68 req-66baa011-93e1-4a3f-8f81-5e9fe5d8d374 service nova] Enqueued Resource ID: c3ab3b95-ba47-476a-8431-38016deb9c1a with Priority: HIGHEST for action port [ 914.350323] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 914.350629] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 914.350855] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ab3b95-ba47-476a-8431-38016deb9c1a with Priority: HIGHEST for action port [ 914.351386] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.352202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.352202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.352202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.352945] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.354954] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.354954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.356633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3ab3b95-ba47-476a-8431-38016deb9c1a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.356633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3ab3b95-ba47-476a-8431-38016deb9c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.356633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3ab3b95-ba47-476a-8431-38016deb9c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.356633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3ab3b95-ba47-476a-8431-38016deb9c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.356633] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ab3b95-ba47-476a-8431-38016deb9c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.859146] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3ab3b95-ba47-476a-8431-38016deb9c1a with status ACTIVE [ 914.859146] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.859146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.859146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.859336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.859405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.859610] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.859711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.859774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.859920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.859999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.860194] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.860312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.860361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.860495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.860803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.860803] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3ab3b95-ba47-476a-8431-38016deb9c1a is going to be updated. [ 914.862382] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.862520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.886158] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.886378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.886378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.886588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.886717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.886938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3ab3b95-ba47-476a-8431-38016deb9c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.190579] env[69358]: INFO networking_nsxv3.common.synchronization [req-11dfc156-be5e-49c7-9eb4-84220b3faa09 req-82e5d254-5042-45ac-aab4-853edb5820c9 tempest-ServersWithSpecificFlavorTestJSON-1142878247 tempest-ServersWithSpecificFlavorTestJSON-1142878247-project-member] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 915.191154] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 915.191461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.191610] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.191663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.191842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.192195] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.192430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.192542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.192796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.192937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.193096] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.693232] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-338 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.693232] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-338" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.693232] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-338" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.693815] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-338" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.694177] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.694360] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.694503] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.694926] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.695147] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.695385] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.695504] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.695622] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.695740] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.695852] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.695960] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.696110] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.700517] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.700517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.700656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.700776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.700882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.701121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.701238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.701304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.701474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.701659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.701659] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be deleted. [ 915.725119] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.725233] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 915.725693] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.725693] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-338" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.725844] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-38e09be4-3a26-470d-ab5d-1724a566b854 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.726046] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-38e09be4-3a26-470d-ab5d-1724a566b854" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.726217] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-38e09be4-3a26-470d-ab5d-1724a566b854" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.726601] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-38e09be4-3a26-470d-ab5d-1724a566b854" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.726713] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e09be4-3a26-470d-ab5d-1724a566b854',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.736826] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.737088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.737088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.737370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.737486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.737604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.791487] env[69358]: INFO networking_nsxv3.common.synchronization [req-97dda290-54c5-419b-8132-fa3eed04863d req-c578a5fc-e9d0-4a18-882f-d90686f3c8b8 tempest-InstanceActionsTestJSON-2103089501 tempest-InstanceActionsTestJSON-2103089501-project-member] Enqueued Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGHEST for action security_group_members [ 915.792045] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGHEST for action security_group_members [ 915.793145] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-20029fd2-1ece-44e8-95e9-efcf32b1a108 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.793145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.793145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.793145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.793145] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.793145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.793504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.793670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.793759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.793852] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.857633] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 915.857759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.173120] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 916.173388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.173624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.173929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.174197] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.174371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.174444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.174788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.174911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.175032] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.229118] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.229386] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.229521] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.229890] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.230062] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.230253] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 38e09be4-3a26-470d-ab5d-1724a566b854 not found, creating... [ 916.230582] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.230765] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.230889] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.231176] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.231336] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.231688] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.232397] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.232397] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.232397] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.232565] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.232691] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 38e09be4-3a26-470d-ab5d-1724a566b854 is going to be created. [ 916.252952] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.253202] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.253341] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.253653] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.253900] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.254150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-38e09be4-3a26-470d-ab5d-1724a566b854" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.296247] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.296453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.296523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.296822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.296972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.297230] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.297387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.297482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.297683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.297748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.297888] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 is going to be updated. [ 916.329095] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.329095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.329095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.329095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.329095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.350280] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 in Status: IN_PROGRESS for 2s [ 916.677036] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.121302] env[69358]: INFO networking_nsxv3.common.synchronization [req-11dfc156-be5e-49c7-9eb4-84220b3faa09 req-aa56e605-63c7-4c91-86e0-df591e483d57 service nova] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_rules [ 917.121302] env[69358]: INFO networking_nsxv3.common.synchronization [req-11dfc156-be5e-49c7-9eb4-84220b3faa09 req-aa56e605-63c7-4c91-86e0-df591e483d57 service nova] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 917.121302] env[69358]: INFO networking_nsxv3.common.synchronization [req-11dfc156-be5e-49c7-9eb4-84220b3faa09 req-aa56e605-63c7-4c91-86e0-df591e483d57 service nova] Enqueued Resource ID: 38e09be4-3a26-470d-ab5d-1724a566b854 with Priority: HIGHEST for action port [ 917.121302] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_rules [ 917.121302] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 917.121302] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e09be4-3a26-470d-ab5d-1724a566b854 with Priority: HIGHEST for action port [ 917.121302] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.121302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.121302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.124018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.124018] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.124710] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.124878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.124913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.125103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.125271] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.125372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.125533] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.125587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.125646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.125764] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.126801] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e09be4-3a26-470d-ab5d-1724a566b854 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.126801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e09be4-3a26-470d-ab5d-1724a566b854" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.126801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e09be4-3a26-470d-ab5d-1724a566b854" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.126986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e09be4-3a26-470d-ab5d-1724a566b854" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.126986] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e09be4-3a26-470d-ab5d-1724a566b854',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.179769] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.625913] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.626441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.628447] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.631838] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38e09be4-3a26-470d-ab5d-1724a566b854 with status ACTIVE [ 917.633180] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.633246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.633344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.633579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.633670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.634749] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.634749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.634749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.634749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.634749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.634749] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.634749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.634749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.635043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.635043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.635043] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38e09be4-3a26-470d-ab5d-1724a566b854 is going to be updated. [ 917.653529] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.653714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.653786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.653999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.654167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.654328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e09be4-3a26-470d-ab5d-1724a566b854" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.681842] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.682024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.682100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.682276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.682365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.682462] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 917.729173] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.729795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.729795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.729795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.729795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.752868] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 918.131459] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.359141] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 in Status: SUCCESS [ 918.359315] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 deletion is rescheduled due to dependency. [ 918.359432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.634450] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.634605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.634700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.635528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.635528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.635528] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be created. [ 918.658967] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.659288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.659288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.659554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.659697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.672813] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: UNINITIALIZED for 2s [ 919.761877] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 919.762248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.762381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.762626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.762943] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.763098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.763161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.763346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.763430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.763515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.763617] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.131076] env[69358]: INFO networking_nsxv3.common.synchronization [req-f023369d-4466-4921-b2e8-0fa2b97ac1a3 req-2c656e05-553b-4bbe-a715-ee7ad99e909e tempest-ServerActionsV293TestJSON-324495238 tempest-ServerActionsV293TestJSON-324495238-project-member] Enqueued Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_members [ 920.131511] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_members [ 920.132063] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-8effc622-7de8-42df-98f1-20eb9e446c1a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.135062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.135260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.135597] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.135821] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.135964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.136097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.136317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.136390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.136676] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.266670] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.266821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.266904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.267228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.267451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.267585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.267672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.267867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.267982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.268112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.268305] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.268429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.268512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.268694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.268884] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.269018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.269104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.269299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.269405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.269513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.269634] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.642361] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.643991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.643991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.643991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.643991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.643991] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.643991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.643991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.643991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.643991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.643991] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8effc622-7de8-42df-98f1-20eb9e446c1a already deleted. [ 920.644344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.684755] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: SUCCESS [ 920.685042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.685173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.685391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.685583] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.685721] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.685809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.686294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.686294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.686294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.686294] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.709000] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.709000] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-793" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.709256] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-793" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.709623] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-793" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.709951] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.710356] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.710356] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.710994] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.710994] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.711194] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.711347] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.711488] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.711628] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.711823] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.712062] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.712309] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.734296] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.734476] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.735042] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.735042] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-793" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.735228] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.735441] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.735600] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.735996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.736175] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ceccb8c-b149-4daa-a1c9-a8d67119fb97',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.772646] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 920.790244] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.790456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.790541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.790807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.791222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.791222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.791624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.791681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.792254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.792254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.792254] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.792254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.792505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.792505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.792574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.792718] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.792809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.792869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.793011] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.793586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.793586] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 920.861442] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.861442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.861442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.861639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.862323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.879931] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 921.190802] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.239245] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.242022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.242022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.242022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.242022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.242022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 7ceccb8c-b149-4daa-a1c9-a8d67119fb97 not found, creating... [ 921.242022] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.242022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.242022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.242022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.242022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.242880] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.243245] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.243716] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.244116] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.245385] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.245732] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 7ceccb8c-b149-4daa-a1c9-a8d67119fb97 is going to be created. [ 921.266229] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.266229] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.266229] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.266229] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.266229] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.266229] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.693576] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 689199c8-8cdd-4299-865b-276e93b23c6b: rpc.has_security_group_logging(os_id): False [ 921.714239] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.716974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.716974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.716974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.716974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.716974] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.716974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.716974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.716974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.716974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.716974] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be created. [ 921.771883] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.772053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.772150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.772413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.772683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.786537] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: IN_PROGRESS for 2s [ 922.062022] env[69358]: INFO networking_nsxv3.common.synchronization [req-f023369d-4466-4921-b2e8-0fa2b97ac1a3 req-1cea945f-b163-4a85-89bc-ee13ff01d916 service nova] Enqueued Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_rules [ 922.062022] env[69358]: INFO networking_nsxv3.common.synchronization [req-f023369d-4466-4921-b2e8-0fa2b97ac1a3 req-1cea945f-b163-4a85-89bc-ee13ff01d916 service nova] Enqueued Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_members [ 922.062022] env[69358]: INFO networking_nsxv3.common.synchronization [req-f023369d-4466-4921-b2e8-0fa2b97ac1a3 req-1cea945f-b163-4a85-89bc-ee13ff01d916 service nova] Enqueued Resource ID: 7ceccb8c-b149-4daa-a1c9-a8d67119fb97 with Priority: HIGHEST for action port [ 922.062022] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_rules [ 922.062022] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_members [ 922.062022] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceccb8c-b149-4daa-a1c9-a8d67119fb97 with Priority: HIGHEST for action port [ 922.062581] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8effc622-7de8-42df-98f1-20eb9e446c1a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.062830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.066892] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.066892] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-8effc622-7de8-42df-98f1-20eb9e446c1a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.066892] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.066892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.066892] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.069717] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.069976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.071037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.071037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.071037] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ceccb8c-b149-4daa-a1c9-a8d67119fb97',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.572351] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.573784] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-8effc622-7de8-42df-98f1-20eb9e446c1a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.573927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.574295] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ceccb8c-b149-4daa-a1c9-a8d67119fb97 with status ACTIVE [ 922.574942] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.574942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.574942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.575963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.576129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.576446] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.576678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.576743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.577324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.577581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.577790] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.577903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.577954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.578110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.578188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.578749] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ceccb8c-b149-4daa-a1c9-a8d67119fb97 is going to be updated. [ 922.599537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.599537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.599537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.599537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.599537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.599537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ceccb8c-b149-4daa-a1c9-a8d67119fb97" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.894710] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 922.895134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.074781] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.125273] env[69358]: INFO networking_nsxv3.common.synchronization [None req-f809a290-f136-4f1e-bb61-a8399fbd27a6 None None] Enqueued Resource ID: 59a6670a-53f8-4c92-89bc-f75d850cd2b8 with Priority: HIGHEST for action port [ 923.125842] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59a6670a-53f8-4c92-89bc-f75d850cd2b8 with Priority: HIGHEST for action port [ 923.126143] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-59a6670a-53f8-4c92-89bc-f75d850cd2b8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.126690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59a6670a-53f8-4c92-89bc-f75d850cd2b8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.126769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59a6670a-53f8-4c92-89bc-f75d850cd2b8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.127125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59a6670a-53f8-4c92-89bc-f75d850cd2b8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.127215] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59a6670a-53f8-4c92-89bc-f75d850cd2b8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.580152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.580430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.580523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.580798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.580903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.581018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8effc622-7de8-42df-98f1-20eb9e446c1a is going to be created. [ 923.606191] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.607412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.607412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.607538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.607650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.617240] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8effc622-7de8-42df-98f1-20eb9e446c1a in Status: UNINITIALIZED for 2s [ 923.631049] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59a6670a-53f8-4c92-89bc-f75d850cd2b8 [ 923.631422] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.631614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.631672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.631946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.632087] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.632211] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59a6670a-53f8-4c92-89bc-f75d850cd2b8 already deleted. [ 923.632622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59a6670a-53f8-4c92-89bc-f75d850cd2b8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.800825] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: SUCCESS [ 923.801080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.151052] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ba256f9c-d24e-4ad8-b330-c6e61a6004b1 tempest-ServersV294TestFqdnHostnames-1528970364 tempest-ServersV294TestFqdnHostnames-1528970364-project-member] Enqueued Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_rules [ 924.151052] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_rules [ 924.151052] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2c85ab1-5f4b-4878-9858-c616793b3b32 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.151052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.151052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.152661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.152661] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.264854] env[69358]: INFO networking_nsxv3.common.synchronization [None req-9f1d58f2-ed16-463f-8fd4-d31fe14dd4e7 tempest-ServersV294TestFqdnHostnames-1528970364 tempest-ServersV294TestFqdnHostnames-1528970364-project-member] Enqueued Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_rules [ 924.265547] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_rules [ 924.265909] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2c85ab1-5f4b-4878-9858-c616793b3b32 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.266086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.672956] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.672956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.675181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.675181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.675181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.675181] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 already deleted. [ 924.675181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.675181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.675181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.675181] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.977415] env[69358]: INFO networking_nsxv3.common.synchronization [req-f1c3ab3e-952f-4e1b-b91b-69a2e8bacc97 req-88f02a56-cddc-4506-bd29-354cf5140e89 tempest-ServersAdminNegativeTestJSON-1854851698 tempest-ServersAdminNegativeTestJSON-1854851698-project-member] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 924.977415] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGHEST for action security_group_members [ 924.983064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.983064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.983064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.983064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.983064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.983064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.983064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.983064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.983064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.983064] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.199589] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.199589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.199589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.199589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.199589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.199589] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 already deleted. [ 925.199589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.485834] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.486027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.486182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.486327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.486422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.486616] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.486713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.486773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.486921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.487047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.487128] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be updated. [ 925.512058] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.512222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.512293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.513377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.513573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.522440] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: IN_PROGRESS for 2s [ 925.628057] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8effc622-7de8-42df-98f1-20eb9e446c1a in Status: SUCCESS [ 925.628057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.628232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.628422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.628613] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.628724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.628789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.628932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.629022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.629157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.629188] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.667242] env[69358]: INFO networking_nsxv3.common.synchronization [None req-34268d91-d610-40fa-8336-04306ab6b45d None None] Enqueued Resource ID: eee9db49-4a10-481b-ae9b-fca82fb192a9 with Priority: HIGHEST for action port [ 925.667379] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee9db49-4a10-481b-ae9b-fca82fb192a9 with Priority: HIGHEST for action port [ 925.670222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-eee9db49-4a10-481b-ae9b-fca82fb192a9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.670222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eee9db49-4a10-481b-ae9b-fca82fb192a9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.670222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eee9db49-4a10-481b-ae9b-fca82fb192a9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.670222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eee9db49-4a10-481b-ae9b-fca82fb192a9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.670222] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eee9db49-4a10-481b-ae9b-fca82fb192a9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.104019] env[69358]: INFO networking_nsxv3.common.synchronization [req-d23bb054-351b-4f57-a6bd-878e5df8d7cf req-07a2c0cb-9c71-45c6-aa3b-c32a39a4f2f5 tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 926.104606] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 926.105126] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.107879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.107879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.107879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.109199] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.109385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.109459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.109778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.109876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.110050] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.134632] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.170868] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eee9db49-4a10-481b-ae9b-fca82fb192a9 [ 926.172360] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.172360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.172360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.172360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.172360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.172360] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eee9db49-4a10-481b-ae9b-fca82fb192a9 already deleted. [ 926.172360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eee9db49-4a10-481b-ae9b-fca82fb192a9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.616276] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.636853] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8effc622-7de8-42df-98f1-20eb9e446c1a: rpc.has_security_group_logging(os_id): False [ 926.658237] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.658412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.658472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.658758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.658834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.659363] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.659363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.659363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.659363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.659629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.659629] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8effc622-7de8-42df-98f1-20eb9e446c1a is going to be created. [ 926.722742] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.722904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.722992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.723539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.723539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.734550] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8effc622-7de8-42df-98f1-20eb9e446c1a in Status: IN_PROGRESS for 2s [ 927.120828] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.536521] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 in Status: SUCCESS [ 927.536521] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 deletion is rescheduled due to dependency. [ 927.536521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.624521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.624909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.624909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.625099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.625189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.625289] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 927.655280] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.655458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.655502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.655744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.655896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.664904] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 928.745264] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8effc622-7de8-42df-98f1-20eb9e446c1a in Status: SUCCESS [ 928.745573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.505262] env[69358]: INFO networking_nsxv3.common.synchronization [req-55323fb7-01c9-4cb0-991b-4dcec58c710a req-5e87ce30-bb9e-42cc-9501-5c1beaf9f7b9 tempest-ImagesOneServerNegativeTestJSON-962105235 tempest-ImagesOneServerNegativeTestJSON-962105235-project-member] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 929.505805] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 929.508020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.508301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.508301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.508461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.508809] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.508809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.508809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.509023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.509023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.509131] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.690091] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 929.690305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.931021] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.931021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.931021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.931021] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.932039] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.932261] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.932406] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.932645] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.932800] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.933053] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.933206] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.933299] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.933403] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.933518] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.933628] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.933767] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.956272] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.956455] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 929.956600] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.956778] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-269" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.957120] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-37d75833-0b74-49df-8012-f14e682d6014 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.957309] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-37d75833-0b74-49df-8012-f14e682d6014" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.957433] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-37d75833-0b74-49df-8012-f14e682d6014" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.957805] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-37d75833-0b74-49df-8012-f14e682d6014" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.957952] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37d75833-0b74-49df-8012-f14e682d6014',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.011243] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.011400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.011469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.014170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.038416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.038416] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.038416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.038416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.038416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.038416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.038416] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 930.061779] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.061939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.062026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.062216] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.064065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.070688] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 930.464261] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.464503] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.464635] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.465025] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.465218] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.465384] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 37d75833-0b74-49df-8012-f14e682d6014 not found, creating... [ 930.465652] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.465813] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.465935] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.466201] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.466330] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.466672] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.466874] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.467010] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.467930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.468306] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.468626] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 37d75833-0b74-49df-8012-f14e682d6014 is going to be created. [ 930.488869] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.489255] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.489407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.489727] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.489972] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.490256] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-37d75833-0b74-49df-8012-f14e682d6014" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.322222] env[69358]: INFO networking_nsxv3.common.synchronization [req-55323fb7-01c9-4cb0-991b-4dcec58c710a req-00f52cea-931b-4ec7-b928-4eca1734b196 service nova] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_rules [ 931.322222] env[69358]: INFO networking_nsxv3.common.synchronization [req-55323fb7-01c9-4cb0-991b-4dcec58c710a req-00f52cea-931b-4ec7-b928-4eca1734b196 service nova] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 931.322433] env[69358]: INFO networking_nsxv3.common.synchronization [req-55323fb7-01c9-4cb0-991b-4dcec58c710a req-00f52cea-931b-4ec7-b928-4eca1734b196 service nova] Enqueued Resource ID: 37d75833-0b74-49df-8012-f14e682d6014 with Priority: HIGHEST for action port [ 931.323120] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_rules [ 931.323339] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 931.323535] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37d75833-0b74-49df-8012-f14e682d6014 with Priority: HIGHEST for action port [ 931.324712] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.324712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.324712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.324712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.324712] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.325750] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.325897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.326202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-37d75833-0b74-49df-8012-f14e682d6014 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.326308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37d75833-0b74-49df-8012-f14e682d6014" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.326418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37d75833-0b74-49df-8012-f14e682d6014" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.326808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37d75833-0b74-49df-8012-f14e682d6014" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.327094] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37d75833-0b74-49df-8012-f14e682d6014',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.829188] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.829363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.830287] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37d75833-0b74-49df-8012-f14e682d6014 with status ACTIVE [ 931.830476] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.830590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.830652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.830886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.830957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.831212] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.831212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.831433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.831433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.831538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.831635] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.831724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.831778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.831917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.831994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.832091] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37d75833-0b74-49df-8012-f14e682d6014 is going to be updated. [ 931.855116] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.855116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.855116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.855116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.855406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.855406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37d75833-0b74-49df-8012-f14e682d6014" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.083096] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 932.083298] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 deletion is rescheduled due to dependency. [ 932.083415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.083585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.083793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.084018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.084099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.084167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.084318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.084431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.084497] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.587180] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.090073] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.596036] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.596036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.596036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.596457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.597023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.597023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 933.644111] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.644111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.644111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.644111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.644111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.654014] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 935.665287] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 935.665287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.665287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.665287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.665287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.665287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.665287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.665783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.665783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.665783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.665783] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.168291] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.169614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.169614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.169614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.169614] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.169614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.169614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.169614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.169614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.169614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.170046] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.170046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.170046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.170218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.170218] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.170340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.170397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.170756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.170756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.171050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.171050] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.327209] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 936.327209] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 936.675844] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b755d42e-d250-4f75-9179-3ef054a079c6: rpc.has_security_group_logging(os_id): False [ 936.694126] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.694266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.694836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.694836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.694836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.694836] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.695055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.695055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.695945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.695945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.695945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.695945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.695945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.695945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.695945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.700101] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.700101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.700101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.700101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.700101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.700101] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 936.707579] env[69358]: INFO networking_nsxv3.common.synchronization [None req-64523ac9-835b-4d68-839c-8270a29824b7 None None] Enqueued Resource ID: d6fed454-ba6c-418a-bfd7-c20242b3d87b with Priority: HIGHEST for action port [ 936.708148] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6fed454-ba6c-418a-bfd7-c20242b3d87b with Priority: HIGHEST for action port [ 936.708715] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6fed454-ba6c-418a-bfd7-c20242b3d87b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.708816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6fed454-ba6c-418a-bfd7-c20242b3d87b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.708912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6fed454-ba6c-418a-bfd7-c20242b3d87b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.709181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6fed454-ba6c-418a-bfd7-c20242b3d87b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.709841] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fed454-ba6c-418a-bfd7-c20242b3d87b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.760195] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.760195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.760195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.760195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.760195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.775324] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 937.214945] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6fed454-ba6c-418a-bfd7-c20242b3d87b [ 937.214945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.214945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.214945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.214945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.214945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.214945] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6fed454-ba6c-418a-bfd7-c20242b3d87b already deleted. [ 937.214945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6fed454-ba6c-418a-bfd7-c20242b3d87b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.791728] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 938.793330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.979773] env[69358]: INFO networking_nsxv3.common.synchronization [None req-d86733b2-9f28-4fec-8881-b659fcf1b9df None None] Enqueued Resource ID: 6be3eab6-1841-4f93-8b69-b75947dd2a85 with Priority: HIGHEST for action port [ 938.982024] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be3eab6-1841-4f93-8b69-b75947dd2a85 with Priority: HIGHEST for action port [ 938.982024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-6be3eab6-1841-4f93-8b69-b75947dd2a85 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.982024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6be3eab6-1841-4f93-8b69-b75947dd2a85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.982024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6be3eab6-1841-4f93-8b69-b75947dd2a85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.982024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6be3eab6-1841-4f93-8b69-b75947dd2a85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.982024] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be3eab6-1841-4f93-8b69-b75947dd2a85',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.488974] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6be3eab6-1841-4f93-8b69-b75947dd2a85 [ 939.488974] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.488974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.488974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.488974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.488974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.488974] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6be3eab6-1841-4f93-8b69-b75947dd2a85 already deleted. [ 939.488974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6be3eab6-1841-4f93-8b69-b75947dd2a85" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.648072] env[69358]: INFO networking_nsxv3.common.synchronization [req-984b9520-1f0f-42ba-9a2b-2622a858dbe8 req-6a2fab98-e7b8-4443-b1b5-01025eb49a27 tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 939.648439] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 939.648705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.649319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.649319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.649319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.649489] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.649580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.649641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.649804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.649887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.649976] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.967577] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.967898] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.967898] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.968186] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.968448] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.968613] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.968732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.968947] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.969150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.969371] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.969493] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.969609] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.969721] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.969832] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.970012] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.970077] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.989031] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.989214] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 939.989364] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.989543] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.990042] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-5c13dea9-5962-4c27-a53a-8bcf67109960 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.990161] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-5c13dea9-5962-4c27-a53a-8bcf67109960" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.990213] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-5c13dea9-5962-4c27-a53a-8bcf67109960" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.990524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-5c13dea9-5962-4c27-a53a-8bcf67109960" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.990665] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c13dea9-5962-4c27-a53a-8bcf67109960',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.151446] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.151593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.151665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.151881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.151964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.152162] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.152268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.152308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.152450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.152521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.152602] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 940.200528] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.200705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.200747] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.200956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.201121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.216740] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 940.493315] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.493555] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.493685] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.494062] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.494223] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.494380] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 5c13dea9-5962-4c27-a53a-8bcf67109960 not found, creating... [ 940.494647] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.498022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.498022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.498022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.498022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.498022] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.498022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.498022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.498022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.498022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.498022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 5c13dea9-5962-4c27-a53a-8bcf67109960 is going to be created. [ 940.518693] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.518888] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.519026] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.519298] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.519514] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.519731] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-5c13dea9-5962-4c27-a53a-8bcf67109960" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.064108] env[69358]: INFO networking_nsxv3.common.synchronization [None req-8f879bf4-1a8e-47fc-8e33-00498ccbfd41 None None] Enqueued Resource ID: 7e211f17-88ba-4f66-83c4-8be91f3efa40 with Priority: HIGHEST for action port [ 941.064721] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e211f17-88ba-4f66-83c4-8be91f3efa40 with Priority: HIGHEST for action port [ 941.065959] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e211f17-88ba-4f66-83c4-8be91f3efa40 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.066159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e211f17-88ba-4f66-83c4-8be91f3efa40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.066319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e211f17-88ba-4f66-83c4-8be91f3efa40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.066490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e211f17-88ba-4f66-83c4-8be91f3efa40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.066584] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e211f17-88ba-4f66-83c4-8be91f3efa40',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.316455] env[69358]: INFO networking_nsxv3.common.synchronization [req-984b9520-1f0f-42ba-9a2b-2622a858dbe8 req-5550bbe4-b8cc-4975-bc6a-2a12c746657e service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 941.316645] env[69358]: INFO networking_nsxv3.common.synchronization [req-984b9520-1f0f-42ba-9a2b-2622a858dbe8 req-5550bbe4-b8cc-4975-bc6a-2a12c746657e service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 941.317583] env[69358]: INFO networking_nsxv3.common.synchronization [req-984b9520-1f0f-42ba-9a2b-2622a858dbe8 req-5550bbe4-b8cc-4975-bc6a-2a12c746657e service nova] Enqueued Resource ID: 5c13dea9-5962-4c27-a53a-8bcf67109960 with Priority: HIGHEST for action port [ 941.317583] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 941.317583] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 941.317583] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c13dea9-5962-4c27-a53a-8bcf67109960 with Priority: HIGHEST for action port [ 941.317854] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.317918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.317948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.318155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.318242] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.321168] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.321168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.321168] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c13dea9-5962-4c27-a53a-8bcf67109960 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.321168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c13dea9-5962-4c27-a53a-8bcf67109960" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.321168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c13dea9-5962-4c27-a53a-8bcf67109960" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.321168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c13dea9-5962-4c27-a53a-8bcf67109960" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.321168] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c13dea9-5962-4c27-a53a-8bcf67109960',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.571473] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e211f17-88ba-4f66-83c4-8be91f3efa40 [ 941.571722] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.571914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.571975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.572199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.572312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.572411] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e211f17-88ba-4f66-83c4-8be91f3efa40 already deleted. [ 941.572509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e211f17-88ba-4f66-83c4-8be91f3efa40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.822497] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.822636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.822827] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c13dea9-5962-4c27-a53a-8bcf67109960 with status ACTIVE [ 941.822993] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.825104] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.825104] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.825104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.825546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.825546] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c13dea9-5962-4c27-a53a-8bcf67109960 is going to be updated. [ 941.852427] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.852427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.852427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.852427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.852427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.852427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c13dea9-5962-4c27-a53a-8bcf67109960" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.017263] env[69358]: INFO networking_nsxv3.common.synchronization [None req-07e2f5dd-1a06-41e7-82ae-02dae9660019 tempest-AttachVolumeTestJSON-45129221 tempest-AttachVolumeTestJSON-45129221-project-member] Enqueued Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_rules [ 942.017263] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_rules [ 942.017263] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.017263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.017263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.018632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.018778] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.042464] env[69358]: INFO networking_nsxv3.common.synchronization [req-723b4ba9-717b-4026-aeff-cac254591eef req-130ad682-d0be-4774-b831-0b20f12eee0b tempest-ImagesOneServerNegativeTestJSON-962105235 tempest-ImagesOneServerNegativeTestJSON-962105235-project-member] Enqueued Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 942.044726] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b755d42e-d250-4f75-9179-3ef054a079c6 with Priority: HIGHEST for action security_group_members [ 942.044726] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b755d42e-d250-4f75-9179-3ef054a079c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.044726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.044726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.044726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.044726] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.044726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.044726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.044726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.044726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.044726] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b755d42e-d250-4f75-9179-3ef054a079c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.143983] env[69358]: INFO networking_nsxv3.common.synchronization [None req-70a4b87a-408f-49b8-ba63-b0baf1d52fb5 tempest-AttachVolumeTestJSON-45129221 tempest-AttachVolumeTestJSON-45129221-project-member] Enqueued Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_rules [ 942.144629] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_rules [ 942.144785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.144886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.157491] env[69358]: INFO networking_nsxv3.common.synchronization [req-3c08d380-f598-4564-8097-2e7a00ff49a4 req-eff67960-598a-4e44-bce9-ef1cdd33b1df tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 942.157740] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 942.158552] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.158552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.158552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.158742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.158824] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.158891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.158957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.159131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.159232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.159332] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.226561] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 942.227190] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 942.227593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.227911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.228271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.229345] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.229345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.229345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.231140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.231140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.231140] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.546302] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.546535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.546694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.546981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.547092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.547215] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 already deleted. [ 942.547281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.547608] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.547707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.547768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.547922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.547996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.548174] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.548265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.548324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.548454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.548524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.548602] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 is going to be updated. [ 942.550663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.550663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.550663] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.579783] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.580334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.580400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.580782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.580782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.590656] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: IN_PROGRESS for 2s [ 942.661734] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.662059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.662269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.662570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.662760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.663065] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.663288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.663427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.663658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.663872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.664057] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be deleted. [ 942.696241] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.696404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.696512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.696839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.698607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.698607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.732510] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.778552] env[69358]: INFO networking_nsxv3.common.synchronization [req-3c08d380-f598-4564-8097-2e7a00ff49a4 req-9f13cb92-4f3a-4abf-9e15-8a203e5c0250 tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 942.779073] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 942.779400] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.779569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.779569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.779764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.779905] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.779995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.780126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.780276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.780353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.780443] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.069600] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.069749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.069818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.070036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.070127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.070222] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 already deleted. [ 943.070305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.162761] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.163125] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-538" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.163221] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-538" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.163934] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-538" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.163934] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.164421] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.164659] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.165038] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.165351] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.165715] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.165980] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.166233] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.166531] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.166582] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.166775] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.167018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.184943] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.185355] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.185592] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.186037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-538" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.186527] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a443274c-6bad-4c75-8425-2f0aac87940c taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.186778] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a443274c-6bad-4c75-8425-2f0aac87940c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.186969] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a443274c-6bad-4c75-8425-2f0aac87940c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.187420] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a443274c-6bad-4c75-8425-2f0aac87940c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.187617] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a443274c-6bad-4c75-8425-2f0aac87940c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.235414] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.282858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.283283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.283370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.283617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.283700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.283909] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.284029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.284104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.284248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.284323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.284408] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b already deleted. [ 943.284482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.691429] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.691429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.691429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.691429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.691429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.691429] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a443274c-6bad-4c75-8425-2f0aac87940c not found, creating... [ 943.691750] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.691801] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.691911] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.692260] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.692430] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.692725] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.693137] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.693137] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.693248] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.693386] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.693532] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a443274c-6bad-4c75-8425-2f0aac87940c is going to be created. [ 943.714696] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.714919] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.715062] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.715447] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.715690] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.715917] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a443274c-6bad-4c75-8425-2f0aac87940c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.738852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.738988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.739077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.739280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.739368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.739467] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 943.782551] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.782551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.782551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.782551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.782551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.789949] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 943.868628] env[69358]: INFO networking_nsxv3.common.synchronization [None req-59554540-3626-4c7f-b313-117333ac459d None None] Enqueued Resource ID: b0ce109e-b17c-48ef-80bc-9f448ec22cdc with Priority: HIGHEST for action port [ 943.868628] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0ce109e-b17c-48ef-80bc-9f448ec22cdc with Priority: HIGHEST for action port [ 943.868628] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0ce109e-b17c-48ef-80bc-9f448ec22cdc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.868628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0ce109e-b17c-48ef-80bc-9f448ec22cdc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.868628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0ce109e-b17c-48ef-80bc-9f448ec22cdc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.868628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0ce109e-b17c-48ef-80bc-9f448ec22cdc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.868628] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0ce109e-b17c-48ef-80bc-9f448ec22cdc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.371301] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0ce109e-b17c-48ef-80bc-9f448ec22cdc [ 944.371565] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.371698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.371799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.372090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.372186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.372279] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0ce109e-b17c-48ef-80bc-9f448ec22cdc already deleted. [ 944.372361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0ce109e-b17c-48ef-80bc-9f448ec22cdc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.382034] env[69358]: INFO networking_nsxv3.common.synchronization [req-3c08d380-f598-4564-8097-2e7a00ff49a4 req-62cfa3da-f0b1-40a0-89eb-be9e6a38c13a service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 944.382227] env[69358]: INFO networking_nsxv3.common.synchronization [req-3c08d380-f598-4564-8097-2e7a00ff49a4 req-62cfa3da-f0b1-40a0-89eb-be9e6a38c13a service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 944.382372] env[69358]: INFO networking_nsxv3.common.synchronization [req-3c08d380-f598-4564-8097-2e7a00ff49a4 req-62cfa3da-f0b1-40a0-89eb-be9e6a38c13a service nova] Enqueued Resource ID: a443274c-6bad-4c75-8425-2f0aac87940c with Priority: HIGHEST for action port [ 944.382589] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 944.382716] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 944.382810] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a443274c-6bad-4c75-8425-2f0aac87940c with Priority: HIGHEST for action port [ 944.383430] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.383582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.383615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.383788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.383876] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.385935] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.386065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.386132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.386362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.386552] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.386637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.386698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.386813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.386912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.386998] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.387911] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a443274c-6bad-4c75-8425-2f0aac87940c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.387911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a443274c-6bad-4c75-8425-2f0aac87940c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.387911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a443274c-6bad-4c75-8425-2f0aac87940c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.388102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a443274c-6bad-4c75-8425-2f0aac87940c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.388102] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a443274c-6bad-4c75-8425-2f0aac87940c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.599595] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b755d42e-d250-4f75-9179-3ef054a079c6 in Status: SUCCESS [ 944.599791] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b755d42e-d250-4f75-9179-3ef054a079c6 deletion is rescheduled due to dependency. [ 944.599911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b755d42e-d250-4f75-9179-3ef054a079c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.889850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.890059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.890237] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.891166] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a443274c-6bad-4c75-8425-2f0aac87940c with status ACTIVE [ 944.891347] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.891481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.891552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.891765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.891864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.892089] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.892213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.892280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.892438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.892520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.893115] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.893115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.893115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.893115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.893115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.893115] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a443274c-6bad-4c75-8425-2f0aac87940c is going to be updated. [ 944.912100] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.912100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.912305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.912424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.912528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.912689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a443274c-6bad-4c75-8425-2f0aac87940c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.281132] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.281132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-503" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.281132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-503" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.281132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-503" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.281132] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.281132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.281706] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.282168] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.282704] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.285085] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.285085] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.285085] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.285085] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.285085] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.285085] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.285085] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.305316] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.305316] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.305316] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.305316] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-503" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.305316] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.305316] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.305316] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.305316] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.305316] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6331b852-fda4-4dca-ac0c-73bf17b6eb3a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.395068] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.799105] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 945.799318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.799483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.799693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.799882] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.799994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.800093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.800246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.800331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.800417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.800507] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.808981] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.808981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.808981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.808981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.808981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.808981] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 6331b852-fda4-4dca-ac0c-73bf17b6eb3a not found, creating... [ 945.808981] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.809348] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.809348] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.809431] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.809582] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.809799] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.809984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.810126] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.810300] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.810435] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.810574] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 6331b852-fda4-4dca-ac0c-73bf17b6eb3a is going to be created. [ 945.828444] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.828678] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.828868] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.829095] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.829366] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.829694] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.897299] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.897493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.897572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.897734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.897824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.897932] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be created. [ 945.930507] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.930680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.931225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.931225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.931225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.951547] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: UNINITIALIZED for 2s [ 946.303419] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.303530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.303564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.303770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.303949] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.304063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.304129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.304285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.304482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.304482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.304641] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.304682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.304753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.304874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.305018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.305112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.305172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.305374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.305479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.305561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.305617] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.558859] env[69358]: INFO networking_nsxv3.common.synchronization [req-3c08d380-f598-4564-8097-2e7a00ff49a4 req-754d0456-0b48-4156-957c-d4c1892039f9 service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 946.559103] env[69358]: INFO networking_nsxv3.common.synchronization [req-3c08d380-f598-4564-8097-2e7a00ff49a4 req-754d0456-0b48-4156-957c-d4c1892039f9 service nova] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 946.559190] env[69358]: INFO networking_nsxv3.common.synchronization [req-3c08d380-f598-4564-8097-2e7a00ff49a4 req-754d0456-0b48-4156-957c-d4c1892039f9 service nova] Enqueued Resource ID: 6331b852-fda4-4dca-ac0c-73bf17b6eb3a with Priority: HIGHEST for action port [ 946.559475] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_rules [ 946.559609] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 946.559705] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6331b852-fda4-4dca-ac0c-73bf17b6eb3a with Priority: HIGHEST for action port [ 946.560276] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.560382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.560578] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.560661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.560838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.560937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.561048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.561233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.561285] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6331b852-fda4-4dca-ac0c-73bf17b6eb3a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.808164] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d904f37a-b3f7-4aef-9721-265081cb343b: rpc.has_security_group_logging(os_id): False [ 946.824964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.825113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.825190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.825481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.825584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.825853] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.825980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.826067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.826239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.826319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.826555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.826656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.826720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.826879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.826933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.827131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.827225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.827285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.827425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.827498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.827581] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 946.890544] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.890701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.890771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.890972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.891133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.907065] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 947.066810] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6331b852-fda4-4dca-ac0c-73bf17b6eb3a with status ACTIVE [ 947.066810] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.066810] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.066810] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.066810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.066810] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6331b852-fda4-4dca-ac0c-73bf17b6eb3a is going to be updated. [ 947.088035] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.088035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.088310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.088662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.088920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.089204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6331b852-fda4-4dca-ac0c-73bf17b6eb3a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.965203] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 947.965496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.965638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.965866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.966083] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.966206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.966272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.966423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.966507] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.968029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.968146] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.968979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.970589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.970806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.970923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.970989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.971148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.971297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.971393] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.472928] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.473121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.475582] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.920950] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 948.921271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.977737] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.481802] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.481802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.481802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.481802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.481802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.482078] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 949.511269] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.511367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.511407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.511590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.511726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.521119] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 951.534046] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.534046] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.534046] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.534046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.534870] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.534870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.534870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.534870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.534870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.534870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.534870] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.561085] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 951.561244] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 952.037446] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55e4213-4f47-44ae-b8e8-d46185e8161b: rpc.has_security_group_logging(os_id): False [ 952.055230] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.055441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.055506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.055776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.055884] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.056076] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.056177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.056242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.056393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.056523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.056731] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.056806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.056873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.057019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.057797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.058031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.058139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.058206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.058354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.058435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.058525] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be created. [ 952.113473] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.113684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.113742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.113909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.114112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.126584] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 952.919039] env[69358]: INFO networking_nsxv3.common.synchronization [req-416964ae-89a4-4bf8-8176-fd63ccb0d445 req-5751ce5b-71c6-407b-b07e-fbd9758a00d7 tempest-ServerRescueNegativeTestJSON-1118501628 tempest-ServerRescueNegativeTestJSON-1118501628-project-member] Enqueued Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_members [ 952.919564] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_members [ 952.919893] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.920014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.920079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.920330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.924702] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.925119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.925119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.925297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.925297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.925387] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.242022] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.242176] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.242310] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.243156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.243156] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.243156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.243156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.243433] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.243671] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.243957] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.244113] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.244233] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.244370] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.244468] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.244582] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.244719] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.263261] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.263996] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 953.263996] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.263996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.264171] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-9de7a27d-dd08-462a-9b74-c09e62e15a26 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.264247] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-9de7a27d-dd08-462a-9b74-c09e62e15a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.264331] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-9de7a27d-dd08-462a-9b74-c09e62e15a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.264632] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-9de7a27d-dd08-462a-9b74-c09e62e15a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.264777] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9de7a27d-dd08-462a-9b74-c09e62e15a26',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.427677] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.427916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.428027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.428239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.428327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.428529] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.428639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.428701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.428848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.428923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.429021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 already deleted. [ 953.429101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.768281] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.768498] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.768697] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.768996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.769167] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.769383] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 9de7a27d-dd08-462a-9b74-c09e62e15a26 not found, creating... [ 953.769597] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.769761] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.769883] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.770123] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.770300] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.770664] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.770827] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.770945] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.771172] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.771308] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.771450] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 9de7a27d-dd08-462a-9b74-c09e62e15a26 is going to be created. [ 953.790920] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.791099] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.791239] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.791624] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.791929] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.792288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-9de7a27d-dd08-462a-9b74-c09e62e15a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.142782] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 954.143088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.143299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.143527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.143620] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.569077] env[69358]: INFO networking_nsxv3.common.synchronization [req-416964ae-89a4-4bf8-8176-fd63ccb0d445 req-c614c322-dbee-49b5-95f6-310ebb5196a3 service nova] Enqueued Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_rules [ 954.569187] env[69358]: INFO networking_nsxv3.common.synchronization [req-416964ae-89a4-4bf8-8176-fd63ccb0d445 req-c614c322-dbee-49b5-95f6-310ebb5196a3 service nova] Enqueued Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_members [ 954.569325] env[69358]: INFO networking_nsxv3.common.synchronization [req-416964ae-89a4-4bf8-8176-fd63ccb0d445 req-c614c322-dbee-49b5-95f6-310ebb5196a3 service nova] Enqueued Resource ID: 9de7a27d-dd08-462a-9b74-c09e62e15a26 with Priority: HIGHEST for action port [ 954.569563] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_rules [ 954.569695] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_members [ 954.569793] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de7a27d-dd08-462a-9b74-c09e62e15a26 with Priority: HIGHEST for action port [ 954.570533] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.570533] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.570533] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.570739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.570773] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.571593] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.572262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.572262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.572262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.572262] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.572262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.572262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.572552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.572552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.572552] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.576083] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9de7a27d-dd08-462a-9b74-c09e62e15a26 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.576083] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9de7a27d-dd08-462a-9b74-c09e62e15a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.577167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9de7a27d-dd08-462a-9b74-c09e62e15a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.577346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9de7a27d-dd08-462a-9b74-c09e62e15a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.577431] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9de7a27d-dd08-462a-9b74-c09e62e15a26',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.646034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.646223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.646259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.646733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.646958] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.647148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.647219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.647397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.647484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.647575] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.647662] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.050224] env[69358]: INFO networking_nsxv3.common.synchronization [req-2351152f-05cb-4a7f-b77e-585cc285769f req-e5794348-fac9-441c-8e8c-9f46f27efb77 tempest-ServersAdminTestJSON-846589263 tempest-ServersAdminTestJSON-846589263-project-member] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 955.050754] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 955.051065] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.051191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.051252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.051456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.051602] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.051698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.051752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.051896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.051980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.052110] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.079729] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9de7a27d-dd08-462a-9b74-c09e62e15a26 with status ACTIVE [ 955.079841] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.079961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.080048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.080253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.080343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.080520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.080620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.080682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.080823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.080898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.081084] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.081180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.081233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.081380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.081454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.081538] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9de7a27d-dd08-462a-9b74-c09e62e15a26 is going to be updated. [ 955.082632] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.084669] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.084772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.105478] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.105478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.105478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.105655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.105823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.105963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9de7a27d-dd08-462a-9b74-c09e62e15a26" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.150142] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.150504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.150504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.150682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.151352] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.151352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.151352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.151352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.151352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.151352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.151591] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.151591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.151591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.151680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.151799] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.152476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.152476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.152476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.152476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.152476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.152649] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.554243] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.586345] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.654460] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55e4213-4f47-44ae-b8e8-d46185e8161b: rpc.has_security_group_logging(os_id): False [ 955.674701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.674701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.674701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.674701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.675201] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.675201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.675201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.675201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.675574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.676012] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 955.737211] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.737368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.737441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.737703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.737792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.752008] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 956.056342] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.089521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.089717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.089717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.089936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.090036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.090135] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 is going to be created. [ 956.122502] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.122713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.122713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.122991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.123125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.132386] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 in Status: UNINITIALIZED for 2s [ 956.562024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.562024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.562024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.562024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.562024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.562024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 956.590395] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.590395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.590395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.590395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.590395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.596531] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 957.385310] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4734c9c-e36c-41dc-99c6-1e867fd47eb3 req-9e4972e2-3548-4855-8a5b-2e4c1320a426 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 957.385910] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 957.389275] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.389445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.389541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.390299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.390523] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.392098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.392289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.392679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.392785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.392891] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.691965] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.692266] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.692391] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.692846] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.693203] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.693444] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.693627] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.693913] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.694107] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.698028] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.698028] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.698028] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.698028] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.698028] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.698028] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.698028] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.713362] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.713362] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.713362] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.713362] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.713692] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4d17c4bb-a26b-4689-8539-ee69901a4100 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.713900] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4d17c4bb-a26b-4689-8539-ee69901a4100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.714039] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4d17c4bb-a26b-4689-8539-ee69901a4100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.714539] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4d17c4bb-a26b-4689-8539-ee69901a4100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.714727] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d17c4bb-a26b-4689-8539-ee69901a4100',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.770669] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 957.770891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.896744] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.896975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.896975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.897282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.897380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.897588] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.897679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.897734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.897892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.897969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.898061] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c already deleted. [ 957.898119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.142158] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 in Status: SUCCESS [ 958.142158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.142158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.142361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.142519] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.142688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.142767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.142927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.143027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.143099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.143180] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.218720] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.218720] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.218720] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.218937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.218937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.219108] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 4d17c4bb-a26b-4689-8539-ee69901a4100 not found, creating... [ 958.219367] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.219522] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.219643] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.219928] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.220100] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.220390] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.220554] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.220679] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.221023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.221220] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.221461] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4d17c4bb-a26b-4689-8539-ee69901a4100 is going to be created. [ 958.242887] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.242887] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.242887] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.242887] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.243282] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.243346] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4d17c4bb-a26b-4689-8539-ee69901a4100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.393734] env[69358]: INFO networking_nsxv3.common.synchronization [req-e8ee9214-d16e-4b6c-826c-c207be60e1ac req-2a2f0f95-e62d-45c7-b134-f294968ed53b tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 958.395074] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 958.395074] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.395074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.395074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.395074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.395392] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.395392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.395392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.395927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.395927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.395927] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.491817] env[69358]: INFO networking_nsxv3.common.synchronization [req-4ffaa705-9c77-4619-956f-03fe09f8a7b0 req-e6959ce2-3b4e-4736-b5f9-a43a4ba1a2ca tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 958.493594] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 958.493594] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.493594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.493594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.493594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.494105] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.494105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.494105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.494105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.494895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.494895] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.608576] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 958.608914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.645844] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.683698] env[69358]: INFO networking_nsxv3.common.synchronization [req-e8ee9214-d16e-4b6c-826c-c207be60e1ac req-9bf2b374-b848-46c9-a862-c44af5cc5532 tempest-ServersTestMultiNic-949719855 tempest-ServersTestMultiNic-949719855-project-member] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 958.686762] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGHEST for action security_group_members [ 958.687444] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.687651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.900977] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.997490] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.148126] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770: rpc.has_security_group_logging(os_id): False [ 959.166626] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.166870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.166995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.167336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.167491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.167881] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.168009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.168106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.168311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.168423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.168545] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 is going to be created. [ 959.227951] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.228168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.228271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.228566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.228822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.239598] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 in Status: IN_PROGRESS for 2s [ 959.263742] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.263900] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.264029] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.264318] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.264583] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.264750] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.264879] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.267994] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.268222] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.268455] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 959.268580] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.268699] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.268817] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.268941] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 959.271521] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.271521] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.288692] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.292020] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 959.292020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.292020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.292020] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-9c64b55a-a659-4cda-93da-79860eabeebf taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.292020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-9c64b55a-a659-4cda-93da-79860eabeebf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.292020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-9c64b55a-a659-4cda-93da-79860eabeebf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.292020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-9c64b55a-a659-4cda-93da-79860eabeebf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.292020] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c64b55a-a659-4cda-93da-79860eabeebf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.390832] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4734c9c-e36c-41dc-99c6-1e867fd47eb3 req-e19f612c-8cab-433a-9f8b-5f02bcedf1f7 service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 959.391032] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4734c9c-e36c-41dc-99c6-1e867fd47eb3 req-e19f612c-8cab-433a-9f8b-5f02bcedf1f7 service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 959.391180] env[69358]: INFO networking_nsxv3.common.synchronization [req-e4734c9c-e36c-41dc-99c6-1e867fd47eb3 req-e19f612c-8cab-433a-9f8b-5f02bcedf1f7 service nova] Enqueued Resource ID: 4d17c4bb-a26b-4689-8539-ee69901a4100 with Priority: HIGHEST for action port [ 959.391408] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 959.391536] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 959.391633] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d17c4bb-a26b-4689-8539-ee69901a4100 with Priority: HIGHEST for action port [ 959.393870] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.393870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.393870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.393870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.393870] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.393870] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.394367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.394367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.394367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.394367] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.394502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.394502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.394597] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.394679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.394766] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.395486] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d17c4bb-a26b-4689-8539-ee69901a4100 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.395637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d17c4bb-a26b-4689-8539-ee69901a4100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.395703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d17c4bb-a26b-4689-8539-ee69901a4100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.395848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d17c4bb-a26b-4689-8539-ee69901a4100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.395918] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d17c4bb-a26b-4689-8539-ee69901a4100',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.404120] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.499526] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.798716] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.800360] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.800360] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.800360] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.800520] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.800693] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 9c64b55a-a659-4cda-93da-79860eabeebf not found, creating... [ 959.800903] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.801205] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.801205] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.801409] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.801548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.802245] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.802245] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.802245] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.802418] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.802449] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.802575] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 9c64b55a-a659-4cda-93da-79860eabeebf is going to be created. [ 959.822642] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.822896] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.823031] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.823369] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.823767] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.824149] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-9c64b55a-a659-4cda-93da-79860eabeebf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.898849] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.899327] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.899448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.899600] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d17c4bb-a26b-4689-8539-ee69901a4100 with status ACTIVE [ 959.899743] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.899862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.900023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.900138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.900224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.901895] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.901895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.901895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.901895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.901895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.901895] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.901895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.901895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.901895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.901895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.901895] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d17c4bb-a26b-4689-8539-ee69901a4100 is going to be updated. [ 959.906219] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.906360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.906419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.906569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.906701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.906766] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 959.926013] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.926952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.926952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.926952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.926952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.928251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d17c4bb-a26b-4689-8539-ee69901a4100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.939785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.939917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.940034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.940222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.940363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.949688] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 960.002684] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.002932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.003071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.003437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.003591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.003716] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 960.042326] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.042514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.042637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.042819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.042990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.054595] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 960.403944] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.895794] env[69358]: INFO networking_nsxv3.common.synchronization [req-4ffaa705-9c77-4619-956f-03fe09f8a7b0 req-45584d04-860d-402b-9cad-cea07d87739d service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 960.895912] env[69358]: INFO networking_nsxv3.common.synchronization [req-4ffaa705-9c77-4619-956f-03fe09f8a7b0 req-45584d04-860d-402b-9cad-cea07d87739d service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 960.896842] env[69358]: INFO networking_nsxv3.common.synchronization [req-4ffaa705-9c77-4619-956f-03fe09f8a7b0 req-45584d04-860d-402b-9cad-cea07d87739d service nova] Enqueued Resource ID: 9c64b55a-a659-4cda-93da-79860eabeebf with Priority: HIGHEST for action port [ 960.896842] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 960.896842] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 960.896842] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c64b55a-a659-4cda-93da-79860eabeebf with Priority: HIGHEST for action port [ 960.897420] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.897578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.897651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.897859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.897954] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.898888] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.899264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.901042] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c64b55a-a659-4cda-93da-79860eabeebf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.901042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c64b55a-a659-4cda-93da-79860eabeebf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.901042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c64b55a-a659-4cda-93da-79860eabeebf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.901042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c64b55a-a659-4cda-93da-79860eabeebf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.901042] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c64b55a-a659-4cda-93da-79860eabeebf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.907537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.907888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.907952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.908783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.908783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.908783] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be created. [ 960.935357] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.935555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.935656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.935887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.939732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.948882] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: UNINITIALIZED for 2s [ 961.213096] env[69358]: INFO networking_nsxv3.common.synchronization [req-4a541871-d3fa-420d-9c14-1779881180cc req-84e57422-2fe9-4f1c-abbf-210bad665a26 tempest-ServersV294TestFqdnHostnames-1528970364 tempest-ServersV294TestFqdnHostnames-1528970364-project-member] Enqueued Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_members [ 961.213636] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_members [ 961.213983] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2c85ab1-5f4b-4878-9858-c616793b3b32 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.214121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.214175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.214496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.214671] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.214807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.214807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.214946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.215092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.215195] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.253983] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 in Status: SUCCESS [ 961.254214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.402016] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.402167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.402374] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c64b55a-a659-4cda-93da-79860eabeebf with status ACTIVE [ 961.403043] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.403043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.403043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.403043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.403043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.403304] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.403304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.403304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.403461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.403538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.404059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.404059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.404059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.404059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.404059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.404341] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c64b55a-a659-4cda-93da-79860eabeebf is going to be updated. [ 961.423132] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.423357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.423436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.423651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.423787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.424160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c64b55a-a659-4cda-93da-79860eabeebf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.718647] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.720163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.720163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.720163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.720163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.720467] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.720467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.720631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.720924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.721058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.721303] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 already deleted. [ 961.721424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.753129] env[69358]: INFO networking_nsxv3.common.synchronization [req-213fbfca-5a28-4d55-8077-61b87ca83976 req-edcd7d4f-0a2b-4e41-8ad3-1ccaa8da3bca tempest-ServersTestBootFromVolume-1590001012 tempest-ServersTestBootFromVolume-1590001012-project-member] Enqueued Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_members [ 961.753940] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6990b0-078a-4815-9003-99ea585a4222 with Priority: HIGHEST for action security_group_members [ 961.754296] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6990b0-078a-4815-9003-99ea585a4222 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.754421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.754504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.754682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.754816] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.754908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.754975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.755410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.755495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.755679] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6990b0-078a-4815-9003-99ea585a4222',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.909972] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.909972] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-761" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.909972] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-761" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.909972] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-761" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.910633] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.910837] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.911012] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.911326] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.911579] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.911922] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.912145] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.914658] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.914658] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.914658] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.914658] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.914658] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.932430] env[69358]: INFO networking_nsxv3.common.synchronization [None req-9c70d6a2-7564-4f3e-b6af-da982b810687 None None] Enqueued Resource ID: 29885e82-66a5-4632-8d39-bfe35ad24c47 with Priority: HIGHEST for action port [ 961.932430] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29885e82-66a5-4632-8d39-bfe35ad24c47 with Priority: HIGHEST for action port [ 961.932430] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-29885e82-66a5-4632-8d39-bfe35ad24c47 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.932430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29885e82-66a5-4632-8d39-bfe35ad24c47" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.932430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29885e82-66a5-4632-8d39-bfe35ad24c47" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.932430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29885e82-66a5-4632-8d39-bfe35ad24c47" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.932430] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29885e82-66a5-4632-8d39-bfe35ad24c47',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.933940] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.934258] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 961.934565] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.936040] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-761" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.936592] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-ec7698be-cf85-4219-9aae-702d67aca312 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.936900] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-ec7698be-cf85-4219-9aae-702d67aca312" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.937192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-ec7698be-cf85-4219-9aae-702d67aca312" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.937828] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-ec7698be-cf85-4219-9aae-702d67aca312" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.940084] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec7698be-cf85-4219-9aae-702d67aca312',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.959648] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 961.960012] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.960273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.960628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.960913] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.961128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.961257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.961514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.961645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.961811] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.063352] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 962.063905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.063905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.064027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.064272] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.064408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.064477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.064679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.064982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.064982] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.259030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.259030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.259030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.259030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.259030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.259030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.259030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.259030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.259030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.259030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.259455] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6990b0-078a-4815-9003-99ea585a4222 is going to be updated. [ 962.285408] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.285727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.286321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.286633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.286725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.296052] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6990b0-078a-4815-9003-99ea585a4222 in Status: IN_PROGRESS for 2s [ 962.441036] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29885e82-66a5-4632-8d39-bfe35ad24c47 [ 962.441326] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.441423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.441493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.441708] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.441798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.441894] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29885e82-66a5-4632-8d39-bfe35ad24c47 already deleted. [ 962.441975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29885e82-66a5-4632-8d39-bfe35ad24c47" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.442484] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.442677] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.442805] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.443049] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.443195] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.444461] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port ec7698be-cf85-4219-9aae-702d67aca312 not found, creating... [ 962.444461] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.444461] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.444461] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.446163] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.446163] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.446729] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.449123] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.449123] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.449123] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.449123] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.449123] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: ec7698be-cf85-4219-9aae-702d67aca312 is going to be created. [ 962.467437] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.467672] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.467840] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.468128] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.468440] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.468835] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-ec7698be-cf85-4219-9aae-702d67aca312" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.469669] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.469669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.469846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.470200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.471797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.472049] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.472167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.472235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.472403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.472485] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.472573] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be updated. [ 962.508501] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.508655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.508730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.508940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.509088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.518484] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: IN_PROGRESS for 2s [ 962.569247] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.957526] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 962.957824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.957894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.958179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.958373] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.958490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.958557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.958705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.958789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.958876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.958967] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.071697] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.286367] env[69358]: INFO networking_nsxv3.common.synchronization [req-4a541871-d3fa-420d-9c14-1779881180cc req-8a0d5eff-f1c4-4951-9689-6e747e57488c service nova] Enqueued Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_rules [ 963.286957] env[69358]: INFO networking_nsxv3.common.synchronization [req-4a541871-d3fa-420d-9c14-1779881180cc req-8a0d5eff-f1c4-4951-9689-6e747e57488c service nova] Enqueued Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_members [ 963.287157] env[69358]: INFO networking_nsxv3.common.synchronization [req-4a541871-d3fa-420d-9c14-1779881180cc req-8a0d5eff-f1c4-4951-9689-6e747e57488c service nova] Enqueued Resource ID: ec7698be-cf85-4219-9aae-702d67aca312 with Priority: HIGHEST for action port [ 963.287696] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_rules [ 963.287850] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_members [ 963.287986] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7698be-cf85-4219-9aae-702d67aca312 with Priority: HIGHEST for action port [ 963.293441] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2c85ab1-5f4b-4878-9858-c616793b3b32 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.293592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.293677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.293893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.293980] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.294918] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2c85ab1-5f4b-4878-9858-c616793b3b32 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.295055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.295103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.295300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.295818] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.295818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.295818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.295818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.296021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.296021] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.297186] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec7698be-cf85-4219-9aae-702d67aca312 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.297838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec7698be-cf85-4219-9aae-702d67aca312" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.297838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec7698be-cf85-4219-9aae-702d67aca312" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.297838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec7698be-cf85-4219-9aae-702d67aca312" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.297838] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec7698be-cf85-4219-9aae-702d67aca312',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.461360] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.461547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.461738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.461842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.461964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.462092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.462142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.462277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.464355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.464355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.464355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.464355] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.576866] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.576866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.576866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.576866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.576866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.576866] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 963.607763] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.608288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.608560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.608871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.609290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.620094] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 963.800956] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2c85ab1-5f4b-4878-9858-c616793b3b32 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.801148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.801495] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.802416] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec7698be-cf85-4219-9aae-702d67aca312 with status ACTIVE [ 963.802726] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.802726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.802855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.803033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.803134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.803464] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.804371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.804679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.805106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.805213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.805414] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.805522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.805578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.805886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.805886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.805972] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec7698be-cf85-4219-9aae-702d67aca312 is going to be updated. [ 963.824801] env[69358]: INFO networking_nsxv3.common.synchronization [None req-414142a1-19a6-4062-89b7-2076198270d7 None None] Enqueued Resource ID: 8e506d8c-ed19-4046-b991-c99545481e48 with Priority: HIGHEST for action port [ 963.825461] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e506d8c-ed19-4046-b991-c99545481e48 with Priority: HIGHEST for action port [ 963.827165] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.827377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.827483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.827782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.827985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.828247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec7698be-cf85-4219-9aae-702d67aca312" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.828916] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e506d8c-ed19-4046-b991-c99545481e48 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.829047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e506d8c-ed19-4046-b991-c99545481e48" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.829122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e506d8c-ed19-4046-b991-c99545481e48" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.829424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e506d8c-ed19-4046-b991-c99545481e48" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.829521] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e506d8c-ed19-4046-b991-c99545481e48',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.935617] env[69358]: INFO networking_nsxv3.common.synchronization [req-ab3cfd07-19cd-4399-bcec-61b6538cd51f req-94873c24-0994-4540-9c12-58c8d4653e2e tempest-ServerDiagnosticsNegativeTest-1004716701 tempest-ServerDiagnosticsNegativeTest-1004716701-project-member] Enqueued Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGHEST for action security_group_members [ 963.935617] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGHEST for action security_group_members [ 963.937658] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.941181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.941297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.941555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.941763] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.941875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.941940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.942137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.942191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.942288] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.966621] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51af08cc-9a30-4dff-8fb1-ae75e324301c: rpc.has_security_group_logging(os_id): False [ 963.984714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.984922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.984995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.985225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.985490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.985798] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.985908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.986704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.986899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.986992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.987201] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.987296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.987361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.987500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.987574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.987749] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.988144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.988144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.988144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.988144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.988293] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be created. [ 964.064720] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.064875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.064935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.065174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.065349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.077329] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 964.310183] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6990b0-078a-4815-9003-99ea585a4222 in Status: SUCCESS [ 964.310408] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6990b0-078a-4815-9003-99ea585a4222 deletion is rescheduled due to dependency. [ 964.310520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6990b0-078a-4815-9003-99ea585a4222" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.310783] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.332072] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e506d8c-ed19-4046-b991-c99545481e48 [ 964.332297] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.332423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.332482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.332689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.332769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.332860] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e506d8c-ed19-4046-b991-c99545481e48 already deleted. [ 964.333054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e506d8c-ed19-4046-b991-c99545481e48" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.352016] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.352223] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.352341] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.352612] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.352928] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.353118] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.353308] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.353454] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.353597] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.353894] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.354039] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.354154] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.354266] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.354378] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.354550] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.354617] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.373452] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.373644] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 964.373787] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.373963] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.374298] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.374479] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.374602] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.374996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.375165] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ec490f-fe08-41a3-81cd-bbcfddcc1937',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.444798] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.447078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.447078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.447078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.447078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.447394] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.447611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.447810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.448392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.448392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.448392] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 already deleted. [ 964.448392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.529067] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55e4213-4f47-44ae-b8e8-d46185e8161b in Status: SUCCESS [ 964.529067] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b deletion is rescheduled due to dependency. [ 964.529067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.813307] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.813526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.813646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.813918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.814071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.814219] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 is going to be created. [ 964.835850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.836013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.836090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.836300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.836457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.847810] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 in Status: UNINITIALIZED for 2s [ 964.878343] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.878572] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.878706] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.878998] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.879157] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.879326] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port f3ec490f-fe08-41a3-81cd-bbcfddcc1937 not found, creating... [ 964.879594] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.879762] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.879878] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.880264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.883019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.883019] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.883019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.883019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.883019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.883019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.883019] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: f3ec490f-fe08-41a3-81cd-bbcfddcc1937 is going to be created. [ 964.904904] env[69358]: INFO networking_nsxv3.common.synchronization [None req-61ffd8b6-bd40-4e80-8045-429943a47ff4 None None] Enqueued Resource ID: 765d86e9-1e9c-448a-ace5-37e6edf4cbd0 with Priority: HIGHEST for action port [ 964.904904] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.904904] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.904904] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.904904] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.906113] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.906557] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.907988] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 765d86e9-1e9c-448a-ace5-37e6edf4cbd0 with Priority: HIGHEST for action port [ 964.908767] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-765d86e9-1e9c-448a-ace5-37e6edf4cbd0 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.908893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-765d86e9-1e9c-448a-ace5-37e6edf4cbd0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.909014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-765d86e9-1e9c-448a-ace5-37e6edf4cbd0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.909327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-765d86e9-1e9c-448a-ace5-37e6edf4cbd0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.909467] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('765d86e9-1e9c-448a-ace5-37e6edf4cbd0',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.411601] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 765d86e9-1e9c-448a-ace5-37e6edf4cbd0 [ 965.411873] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.412016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.413704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.413915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.414024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.414131] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:765d86e9-1e9c-448a-ace5-37e6edf4cbd0 already deleted. [ 965.414218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-765d86e9-1e9c-448a-ace5-37e6edf4cbd0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.630080] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 965.630416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.630484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.630703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.630898] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.631025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.631095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.631248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.631332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.632699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.632699] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.022015] env[69358]: INFO networking_nsxv3.common.synchronization [req-ab3cfd07-19cd-4399-bcec-61b6538cd51f req-929f184b-b091-4094-bfa4-6c28993715f8 service nova] Enqueued Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGHEST for action security_group_rules [ 966.022015] env[69358]: INFO networking_nsxv3.common.synchronization [req-ab3cfd07-19cd-4399-bcec-61b6538cd51f req-929f184b-b091-4094-bfa4-6c28993715f8 service nova] Enqueued Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGHEST for action security_group_members [ 966.022015] env[69358]: INFO networking_nsxv3.common.synchronization [req-ab3cfd07-19cd-4399-bcec-61b6538cd51f req-929f184b-b091-4094-bfa4-6c28993715f8 service nova] Enqueued Resource ID: f3ec490f-fe08-41a3-81cd-bbcfddcc1937 with Priority: HIGHEST for action port [ 966.022015] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGHEST for action security_group_rules [ 966.022015] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGHEST for action security_group_members [ 966.022015] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ec490f-fe08-41a3-81cd-bbcfddcc1937 with Priority: HIGHEST for action port [ 966.023185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.023434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.023434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.023652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.023762] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.024851] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.024851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.024851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.025110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.025281] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.025427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.025427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.025582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.025629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.025712] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.029925] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.029925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.030085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.030346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.030346] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ec490f-fe08-41a3-81cd-bbcfddcc1937',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.088974] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 966.089406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.137261] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.137261] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.137261] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.137261] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.137261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.137958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.137958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.137958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.137958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.137958] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.534559] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.534559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.534559] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.534559] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3ec490f-fe08-41a3-81cd-bbcfddcc1937 with status ACTIVE [ 966.534559] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.534559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.535196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.535196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.536666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.536785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.540024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.540024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.540024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.540024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.540024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.540024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.540024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.540024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.540024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.540024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3ec490f-fe08-41a3-81cd-bbcfddcc1937 is going to be updated. [ 966.544046] env[69358]: INFO networking_nsxv3.common.synchronization [None req-d223562d-a328-403f-a81e-f39067188730 tempest-VolumesAdminNegativeTest-1170171242 tempest-VolumesAdminNegativeTest-1170171242-project-member] Enqueued Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_rules [ 966.547462] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_rules [ 966.547462] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.547462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.547462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.547462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.547462] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.573752] env[69358]: INFO networking_nsxv3.common.synchronization [req-2289f452-045d-4e6a-880f-f0d64dfa1627 req-f7edaacd-dfd6-43ba-bb16-ba6869f8027e tempest-ServerRescueTestJSON-24232825 tempest-ServerRescueTestJSON-24232825-project-member] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 966.575154] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.575717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.575717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.575717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.575843] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.576194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ec490f-fe08-41a3-81cd-bbcfddcc1937" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.577379] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 966.577379] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.577379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.577534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.577709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.578543] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.578778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.578778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.579022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.579566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.579711] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.645503] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e45a41dd-b21d-4639-af89-ce7883a3d987: rpc.has_security_group_logging(os_id): False [ 966.664732] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.665137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.666332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.666332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.666332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.666603] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.666603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.666603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.666728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.666840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.667424] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.667424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.667424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.667424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.667424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.667632] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.671076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.671295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.671931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.671931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.671931] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 966.689505] env[69358]: INFO networking_nsxv3.common.synchronization [req-b86dc4b3-012d-4bf1-a603-8144ef7b664c req-5e01a35c-d337-42d6-b46a-ae9d7a8b27d3 tempest-ServersWithSpecificFlavorTestJSON-1142878247 tempest-ServersWithSpecificFlavorTestJSON-1142878247-project-member] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 966.690368] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGHEST for action security_group_members [ 966.693383] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.693548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.693770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.693943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.696440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.696440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.696440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.696710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.696710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.697042] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.737137] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.737335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.738095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.738095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.738095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.764565] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ba1341c2-7492-47fa-aa3e-459b19ede64f tempest-VolumesAdminNegativeTest-1170171242 tempest-VolumesAdminNegativeTest-1170171242-project-member] Enqueued Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_rules [ 966.766075] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_rules [ 966.766271] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 966.766635] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.766773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.860597] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 in Status: SUCCESS [ 966.860849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.860958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.861321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.862550] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.862550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.862550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.862550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.862550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.862550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.862550] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.044101] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.067972] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.069227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.069227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.069227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.069227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.069227] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 already deleted. [ 967.069227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.069227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.071085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.071085] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.082844] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.083014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.083116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.083366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.083461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.083825] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.083910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.083910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.084102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.084169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.084240] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab already deleted. [ 967.084318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.111632] env[69358]: INFO networking_nsxv3.common.synchronization [None req-2f974041-724b-463c-bb97-0794534f5ec8 None None] Enqueued Resource ID: 182b1c9a-f1df-4be4-81cc-65c5a6dba6f5 with Priority: HIGHEST for action port [ 967.111976] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182b1c9a-f1df-4be4-81cc-65c5a6dba6f5 with Priority: HIGHEST for action port [ 967.112597] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-182b1c9a-f1df-4be4-81cc-65c5a6dba6f5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.112694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-182b1c9a-f1df-4be4-81cc-65c5a6dba6f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.112780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-182b1c9a-f1df-4be4-81cc-65c5a6dba6f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.113064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-182b1c9a-f1df-4be4-81cc-65c5a6dba6f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.113145] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('182b1c9a-f1df-4be4-81cc-65c5a6dba6f5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.129214] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-56 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.129214] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-56" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.129214] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-56" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.129214] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-56" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.129519] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.129519] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.129623] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.130963] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.130963] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.131091] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.131124] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.131239] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.131352] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.131468] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.131577] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.131712] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.151298] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.151615] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 967.151699] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.152408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-56" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.152408] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.152408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.152595] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.156327] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.156327] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9dac7e3-4a02-4c63-9e44-9c3b329a5619',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.201468] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.201645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.201720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.202022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.202119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.202347] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.202453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.204902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.205147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.205270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.205395] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be updated. [ 967.241391] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.241774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.241875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.242341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.242538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.251905] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: IN_PROGRESS for 2s [ 967.364964] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.546655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.546655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.547877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.547877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.547877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.548084] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 is going to be created. [ 967.576748] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.576951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.579839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.580308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.580643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.590955] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 in Status: UNINITIALIZED for 2s [ 967.598207] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.598585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.598736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.599074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.599193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.599313] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 already deleted. [ 967.599440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.615475] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 182b1c9a-f1df-4be4-81cc-65c5a6dba6f5 [ 967.615679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.615844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.615919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.616156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.616246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.616340] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:182b1c9a-f1df-4be4-81cc-65c5a6dba6f5 already deleted. [ 967.616422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-182b1c9a-f1df-4be4-81cc-65c5a6dba6f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.661680] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.661892] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.662034] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.662331] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.662491] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.662647] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port b9dac7e3-4a02-4c63-9e44-9c3b329a5619 not found, creating... [ 967.662906] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.663082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.663206] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.663520] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.663686] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.664012] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.664277] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.664401] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.664619] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.664758] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.664910] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: b9dac7e3-4a02-4c63-9e44-9c3b329a5619 is going to be created. [ 967.683860] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.684110] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.684239] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.684574] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.684882] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.685158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.868137] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2c85ab1-5f4b-4878-9858-c616793b3b32: rpc.has_security_group_logging(os_id): False [ 967.885708] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.885923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.885998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.886306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.886453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.886774] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.887010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.887010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.887212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.887294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.889882] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 is going to be created. [ 967.946768] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.946951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.947191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.947633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.947860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.963642] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 in Status: IN_PROGRESS for 2s [ 968.601618] env[69358]: INFO networking_nsxv3.common.synchronization [req-2289f452-045d-4e6a-880f-f0d64dfa1627 req-80e418aa-2cf8-40d9-95bd-9b8042de4005 service nova] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_rules [ 968.601869] env[69358]: INFO networking_nsxv3.common.synchronization [req-2289f452-045d-4e6a-880f-f0d64dfa1627 req-80e418aa-2cf8-40d9-95bd-9b8042de4005 service nova] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 968.601952] env[69358]: INFO networking_nsxv3.common.synchronization [req-2289f452-045d-4e6a-880f-f0d64dfa1627 req-80e418aa-2cf8-40d9-95bd-9b8042de4005 service nova] Enqueued Resource ID: b9dac7e3-4a02-4c63-9e44-9c3b329a5619 with Priority: HIGHEST for action port [ 968.602203] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_rules [ 968.602329] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 968.602419] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9dac7e3-4a02-4c63-9e44-9c3b329a5619 with Priority: HIGHEST for action port [ 968.602997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.604148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.604254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.604555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.604976] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.607265] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.612034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.612034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.612034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.612034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.612034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.612034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.612034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.612034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.612034] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.618036] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.618036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.618036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.618036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.618036] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9dac7e3-4a02-4c63-9e44-9c3b329a5619',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.781540] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 968.781540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.118011] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.119882] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.119882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.119882] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9dac7e3-4a02-4c63-9e44-9c3b329a5619 with status ACTIVE [ 969.119882] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.120159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.120159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.120374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.120374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.121443] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.121443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.121443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.121443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.121443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.121443] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.121443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.121813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.121813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.121813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.121813] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9dac7e3-4a02-4c63-9e44-9c3b329a5619 is going to be updated. [ 969.141683] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.141683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.141683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.141916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.142010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.142227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9dac7e3-4a02-4c63-9e44-9c3b329a5619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.268864] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 689199c8-8cdd-4299-865b-276e93b23c6b in Status: SUCCESS [ 969.269072] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b deletion is rescheduled due to dependency. [ 969.269177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.601653] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 in Status: SUCCESS [ 969.601653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.602337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.602608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.603571] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.603571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.603571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.603571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.603571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.603571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.603571] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.620233] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.975587] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 in Status: SUCCESS [ 969.975899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.107412] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.107647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.107647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.107853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.108070] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.108191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.108191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.108469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.108469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.108469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.109289] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.109289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.109289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.109289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.109289] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.109289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.109289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.109289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.109820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.109820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.109820] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.128530] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.129748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.129748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.129748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.129748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.129748] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab is going to be created. [ 970.158562] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.158707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.158779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.158993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.159170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.169374] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: UNINITIALIZED for 2s [ 970.367365] env[69358]: INFO networking_nsxv3.common.synchronization [req-020a70c0-f386-431c-bf1f-61916d1ca2f3 req-075b639a-e5ae-425a-ae77-3925f614f982 tempest-MigrationsAdminTest-1296336123 tempest-MigrationsAdminTest-1296336123-project-member] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 970.367922] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 970.368346] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.368508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.368607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.368832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.369025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.369156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.369241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.369418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.369535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.369655] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.612335] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1426a21d-d3c6-4fed-bbe0-ee2b64373b73: rpc.has_security_group_logging(os_id): False [ 970.630642] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.632483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.632651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.632957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.633113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.633673] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.633673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.633673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.633825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.633825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.634077] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.634139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.634171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.634304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.634382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.634558] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.634652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.634714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.634853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.634928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.635025] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 is going to be created. [ 970.707377] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.707526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.707594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.707815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.708039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.717370] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 in Status: IN_PROGRESS for 2s [ 970.872320] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.375035] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.886567] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.886567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.886567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.886567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.886567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.886567] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be updated. [ 971.917115] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.917115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.917115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.917115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.917115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.925348] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: IN_PROGRESS for 2s [ 972.132108] env[69358]: INFO networking_nsxv3.common.synchronization [req-45767dfc-71d9-4156-bbc7-d4db4966644a req-7dfce661-5c54-4ff0-89fe-01aa339f483b tempest-AttachVolumeTestJSON-45129221 tempest-AttachVolumeTestJSON-45129221-project-member] Enqueued Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_members [ 972.134039] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_members [ 972.134039] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.134039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.134039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.134039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.134039] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.134039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.134039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.134557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.134557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.134557] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.182643] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: SUCCESS [ 972.182643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.182643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.182643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.182643] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.182643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.182643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.182643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.182643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.182643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.182643] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.638578] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.638753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.638835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.639131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.639257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.639478] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.639583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.639652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.639861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.639935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.640034] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 already deleted. [ 972.640118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.686055] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.686055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.686055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.686055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.686055] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.686055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.686055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.686055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.686455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.686455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.686455] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.686544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.686573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.687044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.687044] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.687044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.687044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.687260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.687291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.689251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.689251] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.729135] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 in Status: SUCCESS [ 972.729377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.826642] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.826920] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-634" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.827037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-634" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.828094] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-634" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.828094] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.828415] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.828415] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.828698] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.828938] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.830157] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.830910] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.831136] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.831268] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.831403] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.831516] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.831673] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.850295] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.850531] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.850686] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.850882] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-634" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.851575] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4bfa360a-80bf-4e5f-9e86-750dd15530e0 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.851885] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4bfa360a-80bf-4e5f-9e86-750dd15530e0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.851996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4bfa360a-80bf-4e5f-9e86-750dd15530e0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.852452] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4bfa360a-80bf-4e5f-9e86-750dd15530e0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.852631] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bfa360a-80bf-4e5f-9e86-750dd15530e0',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.190227] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72792bb3-b78f-4b14-80d7-1253aec704ab: rpc.has_security_group_logging(os_id): False [ 973.207961] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.208240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.208311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.208542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.208672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.208895] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.208992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.209149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.209240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.209314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.209560] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.209655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.209736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.209886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.209994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.210241] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.210340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.210438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.210617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.210683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.210778] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab is going to be created. [ 973.276827] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.277443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.277625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.277790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.277997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.288494] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: IN_PROGRESS for 2s [ 973.357495] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.357495] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.357495] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.357495] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.357495] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.357495] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 4bfa360a-80bf-4e5f-9e86-750dd15530e0 not found, creating... [ 973.357495] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.358000] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.358000] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.358636] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.358636] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.358636] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.358894] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.358925] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.359229] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.359330] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.359483] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4bfa360a-80bf-4e5f-9e86-750dd15530e0 is going to be created. [ 973.382880] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.383118] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.383167] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.383507] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.383669] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.383916] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4bfa360a-80bf-4e5f-9e86-750dd15530e0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.848948] env[69358]: INFO networking_nsxv3.common.synchronization [req-48fe23a7-6823-4815-83ca-7a827aeb787c req-e21a698d-7818-4c2c-a7fc-e811ffb53c05 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 973.848948] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 973.848948] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.848948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.848948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.850055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.850410] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.850581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.850684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.850913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.851101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.851308] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.936331] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: SUCCESS [ 973.937741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.249143] env[69358]: INFO networking_nsxv3.common.synchronization [req-45767dfc-71d9-4156-bbc7-d4db4966644a req-11bdc71c-8c8e-4b8e-81b3-9cf287b5aeb6 service nova] Enqueued Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_rules [ 974.249143] env[69358]: INFO networking_nsxv3.common.synchronization [req-45767dfc-71d9-4156-bbc7-d4db4966644a req-11bdc71c-8c8e-4b8e-81b3-9cf287b5aeb6 service nova] Enqueued Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_members [ 974.249143] env[69358]: INFO networking_nsxv3.common.synchronization [req-45767dfc-71d9-4156-bbc7-d4db4966644a req-11bdc71c-8c8e-4b8e-81b3-9cf287b5aeb6 service nova] Enqueued Resource ID: 4bfa360a-80bf-4e5f-9e86-750dd15530e0 with Priority: HIGHEST for action port [ 974.249805] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_rules [ 974.249805] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_members [ 974.249805] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bfa360a-80bf-4e5f-9e86-750dd15530e0 with Priority: HIGHEST for action port [ 974.250403] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.250609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.250687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.251050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.251050] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.252492] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.254273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.254273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.254273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.254273] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.254273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.254273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.254273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.254273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.254273] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.255527] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bfa360a-80bf-4e5f-9e86-750dd15530e0 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.255527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bfa360a-80bf-4e5f-9e86-750dd15530e0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.255527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bfa360a-80bf-4e5f-9e86-750dd15530e0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.255709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bfa360a-80bf-4e5f-9e86-750dd15530e0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.255709] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bfa360a-80bf-4e5f-9e86-750dd15530e0',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.354602] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.354807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.354807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.355096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.355184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.355336] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.355414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.355462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.355982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.355982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.355982] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 974.388396] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.388806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.388887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.389928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.390236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.400656] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 974.753059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.753241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.762370] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.763404] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bfa360a-80bf-4e5f-9e86-750dd15530e0 with status ACTIVE [ 974.763527] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.763653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.763722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.763954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.764057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.764237] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.764336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.764531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.764588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.764619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.765436] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.765436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.765436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.765436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.765436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.765436] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bfa360a-80bf-4e5f-9e86-750dd15530e0 is going to be updated. [ 974.786551] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.786704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.786750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.786945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.787100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.787334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bfa360a-80bf-4e5f-9e86-750dd15530e0" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.269325] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.302718] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: SUCCESS [ 975.302718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.771849] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.772053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.772131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.772475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.772475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.772568] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 is going to be created. [ 975.796613] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.796613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.796613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.796613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.796613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.805341] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 in Status: UNINITIALIZED for 2s [ 976.274731] env[69358]: INFO networking_nsxv3.common.synchronization [None req-59df76ce-9084-4a6e-8004-4eb12c9f2dff None None] Enqueued Resource ID: ca507b16-c2d5-49e9-9135-e3b9ac6d318d with Priority: HIGHEST for action port [ 976.275459] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca507b16-c2d5-49e9-9135-e3b9ac6d318d with Priority: HIGHEST for action port [ 976.276072] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca507b16-c2d5-49e9-9135-e3b9ac6d318d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.276316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca507b16-c2d5-49e9-9135-e3b9ac6d318d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.276316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca507b16-c2d5-49e9-9135-e3b9ac6d318d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.276584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca507b16-c2d5-49e9-9135-e3b9ac6d318d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.277820] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca507b16-c2d5-49e9-9135-e3b9ac6d318d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.411323] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 976.411500] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c deletion is rescheduled due to dependency. [ 976.411611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.779737] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca507b16-c2d5-49e9-9135-e3b9ac6d318d [ 976.779952] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.780213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.780287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.780505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.780668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.780725] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca507b16-c2d5-49e9-9135-e3b9ac6d318d already deleted. [ 976.780771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca507b16-c2d5-49e9-9135-e3b9ac6d318d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.252712] env[69358]: INFO networking_nsxv3.common.synchronization [req-806bc284-c2a1-4559-9601-a3f031c1e4ae req-2a4ca1f0-d88b-4179-a568-6ec8182e4ca6 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_members [ 977.255678] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGHEST for action security_group_members [ 977.255678] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.255678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.255678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.255678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.255678] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.256009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.256009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.257195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.257304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.258052] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.761507] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.761769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.761769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.761952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.762055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.762252] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.762352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.762412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.762770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.762852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.762942] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 is going to be updated. [ 977.789797] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.789963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.790051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.790262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.790404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.800149] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 in Status: IN_PROGRESS for 2s [ 977.812659] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 in Status: SUCCESS [ 977.812872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.813046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.813266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.813465] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.813568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.813632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.813776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.813855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.813978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.814119] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.148334] env[69358]: INFO networking_nsxv3.common.synchronization [req-c931d9ec-8484-4b10-9077-83d0d1fc6390 req-5c9e4343-b56e-417a-b57d-90edadbcf4ee tempest-ServerActionsV293TestJSON-324495238 tempest-ServerActionsV293TestJSON-324495238-project-member] Enqueued Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_members [ 978.148964] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGHEST for action security_group_members [ 978.149366] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-8effc622-7de8-42df-98f1-20eb9e446c1a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.150158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.150236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.151503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.151718] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.151868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.152423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.152677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.152794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.152901] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.316409] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.658801] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.658801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.658936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.659155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.659193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.659371] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.659471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.659534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.659684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.659762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.659849] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8effc622-7de8-42df-98f1-20eb9e446c1a is going to be updated. [ 978.685122] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.685365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.685443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.685715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.686022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.696183] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8effc622-7de8-42df-98f1-20eb9e446c1a in Status: IN_PROGRESS for 2s [ 978.724040] env[69358]: INFO networking_nsxv3.common.synchronization [None req-957a7a18-71c3-45dc-9995-598d9c969e34 None None] Enqueued Resource ID: c621ac3a-7bb6-43c4-9cf5-7fcb9013f290 with Priority: HIGHEST for action port [ 978.724121] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c621ac3a-7bb6-43c4-9cf5-7fcb9013f290 with Priority: HIGHEST for action port [ 978.728032] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-c621ac3a-7bb6-43c4-9cf5-7fcb9013f290 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.728032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c621ac3a-7bb6-43c4-9cf5-7fcb9013f290" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.728032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c621ac3a-7bb6-43c4-9cf5-7fcb9013f290" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.728032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c621ac3a-7bb6-43c4-9cf5-7fcb9013f290" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.728032] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c621ac3a-7bb6-43c4-9cf5-7fcb9013f290',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.819469] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf5ed3a6-0a90-4a9d-be28-a119103e9c61: rpc.has_security_group_logging(os_id): False [ 978.837611] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.837751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.837821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.838035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.838125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.838380] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.838608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.838608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.838736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.838810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.838896] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 is going to be created. [ 978.903149] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.903411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.903411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.903567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.903751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.913227] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 in Status: IN_PROGRESS for 2s [ 978.932927] env[69358]: INFO networking_nsxv3.common.synchronization [req-3e219b02-26ab-42ac-84ac-a90b20391f4c req-f34962e5-9586-4bf6-978a-e5c65865b07b tempest-SecurityGroupRulesNegativeTestJSON-842736777 tempest-SecurityGroupRulesNegativeTestJSON-842736777-project-member] Enqueued Resource ID: 941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3 with Priority: HIGHEST for action security_group_rules [ 978.934917] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3 with Priority: HIGHEST for action security_group_rules [ 978.935205] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.935345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.935345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.935642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.935716] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.227539] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c621ac3a-7bb6-43c4-9cf5-7fcb9013f290 [ 979.228081] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.228081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.228246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.228386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.228494] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.228572] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c621ac3a-7bb6-43c4-9cf5-7fcb9013f290 already deleted. [ 979.228661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c621ac3a-7bb6-43c4-9cf5-7fcb9013f290" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.260456] env[69358]: INFO networking_nsxv3.common.synchronization [req-3d0a7858-7720-4310-ad0f-65ad37a3d77b req-ad1e6c03-8153-4ed1-b1c8-04c1baa8ebc7 tempest-SecurityGroupRulesNegativeTestJSON-842736777 tempest-SecurityGroupRulesNegativeTestJSON-842736777-project-member] Enqueued Resource ID: 941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3 with Priority: HIGHEST for action security_group_rules [ 979.260456] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3 with Priority: HIGHEST for action security_group_rules [ 979.260456] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.260593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.454900] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.455121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.455198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.455424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.455496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.455618] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3 already deleted. [ 979.455696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.455896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.456110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.456236] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.809322] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 in Status: SUCCESS [ 979.809322] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 deletion is rescheduled due to dependency. [ 979.809322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.981704] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.981967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.982072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.982775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.982775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.982775] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3 already deleted. [ 979.982775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-941322f4-5f9a-4bdc-b5c9-3cd48a94c8d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.196242] env[69358]: INFO networking_nsxv3.common.synchronization [req-4ffa7bbf-522b-46f9-9d99-41942d68b74d req-8a73422a-3f35-434c-9898-ea19cda93ad0 tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 980.197192] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 980.201755] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.201875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.204615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.204615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.204615] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.204615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.204615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.204615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.204615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.205022] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.709337] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8effc622-7de8-42df-98f1-20eb9e446c1a in Status: SUCCESS [ 980.709337] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8effc622-7de8-42df-98f1-20eb9e446c1a deletion is rescheduled due to dependency. [ 980.709337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.709337] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.924701] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 in Status: SUCCESS [ 980.924870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.211247] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.367080] env[69358]: INFO networking_nsxv3.common.synchronization [req-4d7e9bed-9c27-4606-b1e2-389cd559849e req-0b40c817-7db7-4863-b3e5-f13df35dffc6 tempest-ServerDiagnosticsNegativeTest-1004716701 tempest-ServerDiagnosticsNegativeTest-1004716701-project-member] Enqueued Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGHEST for action security_group_members [ 981.368030] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGHEST for action security_group_members [ 981.368501] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.368681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.368795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.369175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.369419] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.369581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.369688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.370029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.370178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.370325] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.714078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.714368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.714477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.714801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.714953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.715138] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 981.750611] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.750811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.750931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.751249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.751498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.762767] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 981.877355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.877638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.877756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.878081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.878345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.878540] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.878691] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.880016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.880016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.880016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.880016] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 is going to be updated. [ 981.905958] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.906278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.906278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.906464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.906605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.915488] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 in Status: IN_PROGRESS for 2s [ 982.063390] env[69358]: INFO networking_nsxv3.common.synchronization [req-04c7e499-d266-4da1-8cb9-0f80c2f6d03c req-31dc70e3-1632-4185-b962-fa40ff5800fa tempest-ServersAdminTestJSON-846589263 tempest-ServersAdminTestJSON-846589263-project-member] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 982.064029] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGHEST for action security_group_members [ 982.067020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.067020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.067020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.067020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.067020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.067020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.067020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.067020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.067020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.067020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.569710] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.570061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.570061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.570274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.570463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.570760] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.570879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.570948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.571553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.571553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.571553] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be updated. [ 982.624828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.624966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.625050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.625490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.625490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.636413] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: IN_PROGRESS for 2s [ 983.772329] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 983.772329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.924371] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 in Status: SUCCESS [ 983.924700] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 deletion is rescheduled due to dependency. [ 983.924928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.646388] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 in Status: SUCCESS [ 984.646566] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 deletion is rescheduled due to dependency. [ 984.646704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.223371] env[69358]: INFO networking_nsxv3.common.synchronization [req-f5262a35-2af5-429d-b722-cdf4ab37ba64 req-6cf3581c-f317-491f-bdf1-0f802bb28e2b tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 985.223371] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 985.223371] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.223371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.223371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.223371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.223371] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.223371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.223371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.223371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.223371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.223371] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.728706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.728706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.728706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.728706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.728706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.728706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.728706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.728706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.729128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.729128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.729128] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 already deleted. [ 985.729128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.904975] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.905238] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.905384] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.905664] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.905965] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.907468] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.907638] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.907895] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.908104] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.908340] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.908507] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.908628] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.908740] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.908854] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.908961] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.909110] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.930204] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.930396] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 985.930536] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.930844] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.932114] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-fe558574-b3a0-420e-9566-d766cac9a56e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.932114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-fe558574-b3a0-420e-9566-d766cac9a56e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.932114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-fe558574-b3a0-420e-9566-d766cac9a56e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.932114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-fe558574-b3a0-420e-9566-d766cac9a56e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.932114] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe558574-b3a0-420e-9566-d766cac9a56e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.434363] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.434660] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.434787] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.435045] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.435206] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.435367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port fe558574-b3a0-420e-9566-d766cac9a56e not found, creating... [ 986.435649] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.435815] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.435937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.436217] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.436401] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.436756] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.436915] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.437267] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.437407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.437488] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.437741] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: fe558574-b3a0-420e-9566-d766cac9a56e is going to be created. [ 986.457274] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.457542] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.457711] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.458033] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.459277] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.459277] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-fe558574-b3a0-420e-9566-d766cac9a56e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.872693] env[69358]: INFO networking_nsxv3.common.synchronization [req-a77bee0f-70af-4e8b-ab34-92e597605eb8 req-cb4a6c44-4eed-4f0a-bb9d-dce51acd0c84 tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 986.873274] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 986.873598] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.873728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.873806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.874017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.876503] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.876619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.876924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.876924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.876924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.877065] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.358844] env[69358]: INFO networking_nsxv3.common.synchronization [req-f5262a35-2af5-429d-b722-cdf4ab37ba64 req-20d070a6-8413-40cb-adfa-855c33b8afcb service nova] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_rules [ 987.358982] env[69358]: INFO networking_nsxv3.common.synchronization [req-f5262a35-2af5-429d-b722-cdf4ab37ba64 req-20d070a6-8413-40cb-adfa-855c33b8afcb service nova] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 987.359149] env[69358]: INFO networking_nsxv3.common.synchronization [req-f5262a35-2af5-429d-b722-cdf4ab37ba64 req-20d070a6-8413-40cb-adfa-855c33b8afcb service nova] Enqueued Resource ID: fe558574-b3a0-420e-9566-d766cac9a56e with Priority: HIGHEST for action port [ 987.359868] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_rules [ 987.360013] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 987.360130] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe558574-b3a0-420e-9566-d766cac9a56e with Priority: HIGHEST for action port [ 987.360402] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.360605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.360701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.360955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.361053] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.361879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.361997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.362093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.362261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.362405] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.362498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.362558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.364193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.364293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.364388] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.365561] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe558574-b3a0-420e-9566-d766cac9a56e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.365669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe558574-b3a0-420e-9566-d766cac9a56e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.365737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe558574-b3a0-420e-9566-d766cac9a56e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.365892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe558574-b3a0-420e-9566-d766cac9a56e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.365965] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe558574-b3a0-420e-9566-d766cac9a56e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.380505] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.540550] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.540862] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.540912] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.541174] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.541443] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.541607] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.541729] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.541944] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.542108] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.542322] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.542444] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.542559] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.543555] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.543555] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.543555] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.543555] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.560779] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.561133] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 987.561396] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.561707] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.562114] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.562377] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.562569] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.563009] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.563329] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e1bcb17-397d-4b1b-b758-3dc1cf6c86be',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.867659] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.868748] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.868859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.869042] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe558574-b3a0-420e-9566-d766cac9a56e with status ACTIVE [ 987.869203] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.869350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.869403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.870182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.870182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.870182] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.870182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.870182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.870182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.870442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.870442] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.870570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.870570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.870646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.870717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.870796] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe558574-b3a0-420e-9566-d766cac9a56e is going to be updated. [ 987.884555] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.891999] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.892162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.892228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.892450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.892563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.892714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe558574-b3a0-420e-9566-d766cac9a56e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.066485] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.066819] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.067032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.067152] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.067391] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.067517] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 0e1bcb17-397d-4b1b-b758-3dc1cf6c86be not found, creating... [ 988.068020] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.068020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.068212] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.068299] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.068444] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.068759] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.068926] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.069059] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.069311] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.069497] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.069648] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 0e1bcb17-397d-4b1b-b758-3dc1cf6c86be is going to be created. [ 988.087790] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.087951] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.088095] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.088806] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.088806] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.088806] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.374423] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.386915] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.387094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.387188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.387413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.387543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.387810] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 988.415401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.415614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.415614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.415807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.415979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.423743] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 988.879029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.879029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.879029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.879029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.879029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.879029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be created. [ 988.895108] env[69358]: INFO networking_nsxv3.common.synchronization [None req-f3665d29-60b5-4a31-8061-79dab2d3f72f None None] Enqueued Resource ID: b7a8b0a0-a4f9-49b5-9d55-c9419dee9881 with Priority: HIGHEST for action port [ 988.895108] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7a8b0a0-a4f9-49b5-9d55-c9419dee9881 with Priority: HIGHEST for action port [ 988.895362] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7a8b0a0-a4f9-49b5-9d55-c9419dee9881 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.896029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7a8b0a0-a4f9-49b5-9d55-c9419dee9881" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.896029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7a8b0a0-a4f9-49b5-9d55-c9419dee9881" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.896029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7a8b0a0-a4f9-49b5-9d55-c9419dee9881" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.896029] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7a8b0a0-a4f9-49b5-9d55-c9419dee9881',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.900163] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.902335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.902842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.903091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.903286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.915021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: UNINITIALIZED for 2s [ 989.156531] env[69358]: INFO networking_nsxv3.common.synchronization [req-a77bee0f-70af-4e8b-ab34-92e597605eb8 req-41749b89-1225-4959-923d-f34ff9d82a33 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 989.156531] env[69358]: INFO networking_nsxv3.common.synchronization [req-a77bee0f-70af-4e8b-ab34-92e597605eb8 req-41749b89-1225-4959-923d-f34ff9d82a33 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 989.156531] env[69358]: INFO networking_nsxv3.common.synchronization [req-a77bee0f-70af-4e8b-ab34-92e597605eb8 req-41749b89-1225-4959-923d-f34ff9d82a33 service nova] Enqueued Resource ID: 0e1bcb17-397d-4b1b-b758-3dc1cf6c86be with Priority: HIGHEST for action port [ 989.156531] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 989.156531] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 989.156531] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e1bcb17-397d-4b1b-b758-3dc1cf6c86be with Priority: HIGHEST for action port [ 989.156531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.160395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.162688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.162688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.162688] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.162688] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.162688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.162688] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.162688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.162688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.163151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.163151] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e1bcb17-397d-4b1b-b758-3dc1cf6c86be',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.398353] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7a8b0a0-a4f9-49b5-9d55-c9419dee9881 [ 989.398656] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.398798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.398873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.399117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.399207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.399327] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7a8b0a0-a4f9-49b5-9d55-c9419dee9881 already deleted. [ 989.399415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7a8b0a0-a4f9-49b5-9d55-c9419dee9881" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.665269] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.666372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.666372] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e1bcb17-397d-4b1b-b758-3dc1cf6c86be with status ACTIVE [ 989.666372] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.666372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.666372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.666763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.666763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.666763] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.666862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.666924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.667077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.667150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.667336] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.668016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.668016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.668016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.668016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.668016] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e1bcb17-397d-4b1b-b758-3dc1cf6c86be is going to be updated. [ 989.699021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.699213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.699262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.699588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.701726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.701930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e1bcb17-397d-4b1b-b758-3dc1cf6c86be" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.127941] env[69358]: INFO networking_nsxv3.common.synchronization [None req-d8204c4f-0987-4b8a-8181-c20e2ea980cf None None] Enqueued Resource ID: 02c74f44-28ca-42b0-a1b3-3ff50f97cb53 with Priority: HIGHEST for action port [ 990.127941] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c74f44-28ca-42b0-a1b3-3ff50f97cb53 with Priority: HIGHEST for action port [ 990.128462] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-02c74f44-28ca-42b0-a1b3-3ff50f97cb53 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.128598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02c74f44-28ca-42b0-a1b3-3ff50f97cb53" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.128642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02c74f44-28ca-42b0-a1b3-3ff50f97cb53" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.130347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02c74f44-28ca-42b0-a1b3-3ff50f97cb53" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.130347] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02c74f44-28ca-42b0-a1b3-3ff50f97cb53',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.433396] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 990.434034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.434352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.436053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.436053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.436053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.436053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.436053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.436053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.436053] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.632026] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02c74f44-28ca-42b0-a1b3-3ff50f97cb53 [ 990.632173] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.632358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.632521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.632773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.632932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.633063] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02c74f44-28ca-42b0-a1b3-3ff50f97cb53 already deleted. [ 990.633499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02c74f44-28ca-42b0-a1b3-3ff50f97cb53" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.675188] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c75b19b2-5c6d-44f5-a9be-f10ecfe6619a tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 990.675741] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 990.675996] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.676222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.676222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.676478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.676564] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.771155] env[69358]: INFO networking_nsxv3.common.synchronization [None req-18ac2d7a-6312-4fbc-a01e-7d22ae230bfb tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 990.772029] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 990.772029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.772029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.926375] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: SUCCESS [ 990.926949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.927071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.927359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.927589] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.927719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.927824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.928028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.928144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.928260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.928379] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.941753] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.153038] env[69358]: INFO networking_nsxv3.common.synchronization [None req-908399e6-e356-494a-9e96-54861e6a6fd0 None None] Enqueued Resource ID: 20091e3a-3325-473a-a433-a43b01169c33 with Priority: HIGHEST for action port [ 991.153627] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20091e3a-3325-473a-a433-a43b01169c33 with Priority: HIGHEST for action port [ 991.154081] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-20091e3a-3325-473a-a433-a43b01169c33 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.154081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20091e3a-3325-473a-a433-a43b01169c33" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.154427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20091e3a-3325-473a-a433-a43b01169c33" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.154569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20091e3a-3325-473a-a433-a43b01169c33" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.154656] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20091e3a-3325-473a-a433-a43b01169c33',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.198475] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.198952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.199318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.199912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.199912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.199912] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf already deleted. [ 991.199912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.200974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.200974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.200974] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.432680] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.432897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.432971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.433199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.433373] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.433473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.433536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.433679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.433783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.433895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.434063] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.434168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.434241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.434415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.434564] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.434658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.434718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.434856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.434932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.435027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.435224] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.446339] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.587822] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ead197db-9281-4936-b2bf-f088ac5ebf3c tempest-AttachVolumeShelveTestJSON-2021849226 tempest-AttachVolumeShelveTestJSON-2021849226-project-member] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_rules [ 991.588760] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_rules [ 991.589107] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.589823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.589917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.590283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.590283] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.659279] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20091e3a-3325-473a-a433-a43b01169c33 [ 991.659515] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.659650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.659742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.659912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.660009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.660107] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20091e3a-3325-473a-a433-a43b01169c33 already deleted. [ 991.660190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20091e3a-3325-473a-a433-a43b01169c33" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.723528] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.723711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.723753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.723949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.724059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.724205] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf already deleted. [ 991.724317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.778717] env[69358]: INFO networking_nsxv3.common.synchronization [None req-2be19952-8f0b-45e0-89e8-f30581724abd tempest-AttachVolumeShelveTestJSON-2021849226 tempest-AttachVolumeShelveTestJSON-2021849226-project-member] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_rules [ 991.779375] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_rules [ 991.779579] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.779684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.937888] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 012ec087-a6ab-4c42-83a0-58a518f9a415: rpc.has_security_group_logging(os_id): False [ 991.952224] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.952224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.952340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.952489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.952561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.952666] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 991.955376] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.955376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.955376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.955723] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.955723] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.955723] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.955852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.955852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.955988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.956075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.956655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.956655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.956655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.956958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.957052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.957288] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.957415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.957415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.957549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.959772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.959772] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be created. [ 991.980334] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.980672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.980672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.980761] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.980910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.990211] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 992.009911] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.010060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.012017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.012017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.012017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.021399] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: IN_PROGRESS for 2s [ 992.120629] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.120811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.120879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.121103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.121196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.121293] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada already deleted. [ 992.121378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.122030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.122030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.122030] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.644382] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.644382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.644382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.645470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.646106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.646106] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada already deleted. [ 992.646106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.810796] env[69358]: INFO networking_nsxv3.common.synchronization [None req-cea33af2-0c25-4685-b823-5a27ab7a8a9b None None] Enqueued Resource ID: 8ceceb50-62bd-4068-bedb-7f6b9d8a29bd with Priority: HIGHEST for action port [ 992.812531] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ceceb50-62bd-4068-bedb-7f6b9d8a29bd with Priority: HIGHEST for action port [ 992.814999] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ceceb50-62bd-4068-bedb-7f6b9d8a29bd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.814999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ceceb50-62bd-4068-bedb-7f6b9d8a29bd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.814999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ceceb50-62bd-4068-bedb-7f6b9d8a29bd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.814999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ceceb50-62bd-4068-bedb-7f6b9d8a29bd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.814999] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ceceb50-62bd-4068-bedb-7f6b9d8a29bd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.317977] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ceceb50-62bd-4068-bedb-7f6b9d8a29bd [ 993.318537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.319775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.319850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.320131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.320226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.320389] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ceceb50-62bd-4068-bedb-7f6b9d8a29bd already deleted. [ 993.320469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ceceb50-62bd-4068-bedb-7f6b9d8a29bd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.518653] env[69358]: INFO networking_nsxv3.common.synchronization [req-83dc60dc-8442-4d59-b1bd-ac4fd09e9fb4 req-f49aadb6-9ac8-4518-b8e4-143892209f8b tempest-VolumesAdminNegativeTest-1170171242 tempest-VolumesAdminNegativeTest-1170171242-project-member] Enqueued Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_members [ 993.519217] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_members [ 993.519535] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.519767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.519767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.519964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.524407] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.524493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.524548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.524735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.524824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.524923] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.998381] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 993.998672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.998805] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.999178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.999321] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.999459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.999529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.999699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.999782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.999942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.000061] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.027443] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.027622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.027695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.027915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.028042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.028246] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.028345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.028410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.028574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.028669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.028772] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 already deleted. [ 994.028854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.039249] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: SUCCESS [ 994.040346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.159960] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-694 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.160185] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-694" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.160315] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-694" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.161384] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-694" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.161384] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.165075] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.165290] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.165559] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.165719] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.165963] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.167895] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.167895] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.167895] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.167895] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.167895] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.167895] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.188760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.189079] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.189261] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.189456] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-694" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.189791] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a6587c71-f7b0-4b23-9b30-88e814b3ee50 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.189980] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a6587c71-f7b0-4b23-9b30-88e814b3ee50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.190124] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a6587c71-f7b0-4b23-9b30-88e814b3ee50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.190451] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a6587c71-f7b0-4b23-9b30-88e814b3ee50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.190599] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6587c71-f7b0-4b23-9b30-88e814b3ee50',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.502595] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.502794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.502842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.503068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.503244] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.503384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.503450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.503557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.503694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.503745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.503871] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.503997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.504061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.504176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.504355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.504422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.504467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.504627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.504677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.504800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.504870] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.693555] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.693691] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.693795] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.694195] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.694535] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.694751] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a6587c71-f7b0-4b23-9b30-88e814b3ee50 not found, creating... [ 994.695115] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.695330] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.695474] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.695751] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.695935] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.696311] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.696534] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.696694] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.697020] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.697143] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.697308] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a6587c71-f7b0-4b23-9b30-88e814b3ee50 is going to be created. [ 994.715516] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.715670] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.716153] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.716701] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.716796] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.717503] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a6587c71-f7b0-4b23-9b30-88e814b3ee50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.008834] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 995.030070] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.030070] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.030070] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.030070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.031754] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.031754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.031754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.031754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.031754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.031754] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 995.094553] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.094887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.095058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.095314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.095467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.111781] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 995.489623] env[69358]: INFO networking_nsxv3.common.synchronization [req-83dc60dc-8442-4d59-b1bd-ac4fd09e9fb4 req-0fa159cc-6465-4e5a-b4a3-53da597b2f22 service nova] Enqueued Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_rules [ 995.489623] env[69358]: INFO networking_nsxv3.common.synchronization [req-83dc60dc-8442-4d59-b1bd-ac4fd09e9fb4 req-0fa159cc-6465-4e5a-b4a3-53da597b2f22 service nova] Enqueued Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_members [ 995.489623] env[69358]: INFO networking_nsxv3.common.synchronization [req-83dc60dc-8442-4d59-b1bd-ac4fd09e9fb4 req-0fa159cc-6465-4e5a-b4a3-53da597b2f22 service nova] Enqueued Resource ID: a6587c71-f7b0-4b23-9b30-88e814b3ee50 with Priority: HIGHEST for action port [ 995.489623] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_rules [ 995.489623] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_members [ 995.489623] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6587c71-f7b0-4b23-9b30-88e814b3ee50 with Priority: HIGHEST for action port [ 995.489623] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.489623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.489623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.489623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.489623] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.489623] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.490441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.490441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.490441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.490441] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.490441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.490441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.490441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.490824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.490824] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.491612] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6587c71-f7b0-4b23-9b30-88e814b3ee50 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.491612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6587c71-f7b0-4b23-9b30-88e814b3ee50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.491612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6587c71-f7b0-4b23-9b30-88e814b3ee50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.491612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6587c71-f7b0-4b23-9b30-88e814b3ee50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.491865] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6587c71-f7b0-4b23-9b30-88e814b3ee50',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.999426] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6587c71-f7b0-4b23-9b30-88e814b3ee50 with status ACTIVE [ 995.999426] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.999426] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.999426] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.999426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.000166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.000166] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6587c71-f7b0-4b23-9b30-88e814b3ee50 is going to be updated. [ 996.002152] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.003096] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.003198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.024451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.024784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.024784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.024937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.025085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.025278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6587c71-f7b0-4b23-9b30-88e814b3ee50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.504954] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.006844] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.007088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.007088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.007240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.007329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.007503] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 is going to be created. [ 997.029230] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.030236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.032144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.032144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.032144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.041882] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 in Status: UNINITIALIZED for 2s [ 997.124858] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 997.125088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.277098] env[69358]: INFO networking_nsxv3.common.synchronization [req-8af73cc8-be8a-4718-b135-3badeb9ae1af req-ed17f8cc-6901-400d-99fe-068be68545ea tempest-MigrationsAdminTest-1296336123 tempest-MigrationsAdminTest-1296336123-project-member] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 997.278443] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGHEST for action security_group_members [ 997.278443] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.278443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.278443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.278443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.278636] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.278636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.278636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.279146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.279146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.279146] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.718256] env[69358]: INFO networking_nsxv3.common.synchronization [None req-a895e7a2-0036-43da-b591-28b535cb4990 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_rules [ 997.718256] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_rules [ 997.718256] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.718256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.718256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.718934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.719159] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.784151] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.784151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.784151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.784373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.784373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.785205] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.785205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.785205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.785205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.785205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.785205] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be updated. [ 997.808912] env[69358]: INFO networking_nsxv3.common.synchronization [None req-69bcf6ef-750d-4c75-acbb-020e55e1deae tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_rules [ 997.809401] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_rules [ 997.809705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.809819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.814956] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.814956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.814956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.814956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.815566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.829244] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: IN_PROGRESS for 2s [ 998.237891] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.238210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.238210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.238362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.238454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.238513] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 already deleted. [ 998.238811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.238811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.238968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.238968] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.762660] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.762660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.762660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.762660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.762660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.762660] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 already deleted. [ 998.762660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.053937] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 in Status: SUCCESS [ 999.053937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.053937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.053937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.053937] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.053937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.053937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.053937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.053937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.053937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.053937] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.558761] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.840494] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 in Status: SUCCESS [ 999.840695] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 deletion is rescheduled due to dependency. [ 999.840832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.060247] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c21f0b2-3055-4df5-9afa-fd29cf1279d5: rpc.has_security_group_logging(os_id): False [ 1000.081460] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.081614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.081614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.082036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.082161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.082402] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.082506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.082571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.082735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.082816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.082903] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 is going to be created. [ 1000.145734] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.145886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.145958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.146257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.146489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.158109] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 in Status: IN_PROGRESS for 2s [ 1002.170631] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 in Status: SUCCESS [ 1002.170952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.810563] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1002.810698] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1003.291143] env[69358]: INFO networking_nsxv3.common.synchronization [req-5db9cc18-9bbc-49a3-9245-2f269b08de7f req-3448717e-8b03-4513-84d1-c4ac25b56944 tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 1003.291699] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 1003.292442] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.292640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.292720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.292929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.293121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.293230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.293276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.293419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.293562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.293673] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.797171] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.797331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.797400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.797622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.797708] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.797893] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.799023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.799023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.799023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.799023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.799023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 1003.824225] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.824415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.824512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.824740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.824913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.832492] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 1005.843532] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 1005.843532] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 deletion is rescheduled due to dependency. [ 1005.843532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.292633] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1008.292853] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1009.699308] env[69358]: INFO networking_nsxv3.common.synchronization [req-55aa7f52-b770-41db-9090-183ddfdd3705 req-1749e402-17c1-4ed5-b6ea-9cee5e480655 tempest-ServerRescueTestJSON-24232825 tempest-ServerRescueTestJSON-24232825-project-member] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 1009.700302] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 1009.702185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.702332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.703306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.703306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.703306] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.703306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.703306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.703306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.703306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.703306] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.035525] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-56 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.035737] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-56" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.035868] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-56" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.036175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-56" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.036442] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.036603] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.036796] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.037162] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.037337] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.037556] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.037684] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.037816] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.038680] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.038680] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.038680] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.039890] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.059260] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.059260] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.059260] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.059578] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-56" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.059842] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-5044ec6d-3a4d-4012-b40f-d147a698df40 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.059966] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-5044ec6d-3a4d-4012-b40f-d147a698df40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.060133] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-5044ec6d-3a4d-4012-b40f-d147a698df40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.060725] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-5044ec6d-3a4d-4012-b40f-d147a698df40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.060725] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5044ec6d-3a4d-4012-b40f-d147a698df40',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.206550] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.563258] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.563258] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.563455] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.563886] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.563886] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.564037] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 5044ec6d-3a4d-4012-b40f-d147a698df40 not found, creating... [ 1010.564281] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.564444] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.564572] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.564818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.564968] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.565267] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.565430] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.565553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.565764] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.565906] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.566061] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 5044ec6d-3a4d-4012-b40f-d147a698df40 is going to be created. [ 1010.585629] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.585761] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.585867] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.586102] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.586332] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.586557] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-5044ec6d-3a4d-4012-b40f-d147a698df40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.712512] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.215222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.215393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.215501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.215627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.215721] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.215821] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab is going to be updated. [ 1011.246827] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.247028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.247146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.247437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.247577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.258372] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: IN_PROGRESS for 2s [ 1011.305365] env[69358]: INFO networking_nsxv3.common.synchronization [None req-ec46afa8-deb8-416d-862c-1631bd12cdf5 None None] Enqueued Resource ID: bf1cb0b9-d712-4155-99c6-6b8bdb14ea44 with Priority: HIGHEST for action port [ 1011.305964] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1cb0b9-d712-4155-99c6-6b8bdb14ea44 with Priority: HIGHEST for action port [ 1011.306373] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf1cb0b9-d712-4155-99c6-6b8bdb14ea44 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.306541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf1cb0b9-d712-4155-99c6-6b8bdb14ea44" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.306611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf1cb0b9-d712-4155-99c6-6b8bdb14ea44" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.306921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf1cb0b9-d712-4155-99c6-6b8bdb14ea44" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.309231] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1cb0b9-d712-4155-99c6-6b8bdb14ea44',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.768845] env[69358]: INFO networking_nsxv3.common.synchronization [req-55aa7f52-b770-41db-9090-183ddfdd3705 req-a702a543-dc50-4bf2-bba9-00435a1473fc service nova] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_rules [ 1011.769135] env[69358]: INFO networking_nsxv3.common.synchronization [req-55aa7f52-b770-41db-9090-183ddfdd3705 req-a702a543-dc50-4bf2-bba9-00435a1473fc service nova] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 1011.769211] env[69358]: INFO networking_nsxv3.common.synchronization [req-55aa7f52-b770-41db-9090-183ddfdd3705 req-a702a543-dc50-4bf2-bba9-00435a1473fc service nova] Enqueued Resource ID: 5044ec6d-3a4d-4012-b40f-d147a698df40 with Priority: HIGHEST for action port [ 1011.769432] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_rules [ 1011.769562] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 1011.769657] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5044ec6d-3a4d-4012-b40f-d147a698df40 with Priority: HIGHEST for action port [ 1011.770182] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.770307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.770376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.770563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.770643] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.771860] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.771957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.772158] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5044ec6d-3a4d-4012-b40f-d147a698df40 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.772256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5044ec6d-3a4d-4012-b40f-d147a698df40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.773177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5044ec6d-3a4d-4012-b40f-d147a698df40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.773376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5044ec6d-3a4d-4012-b40f-d147a698df40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.773494] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5044ec6d-3a4d-4012-b40f-d147a698df40',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.811832] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf1cb0b9-d712-4155-99c6-6b8bdb14ea44 [ 1011.812065] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.812202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.812272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.812511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.812558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.812642] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf1cb0b9-d712-4155-99c6-6b8bdb14ea44 already deleted. [ 1011.812730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf1cb0b9-d712-4155-99c6-6b8bdb14ea44" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.276421] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.276421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.276871] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5044ec6d-3a4d-4012-b40f-d147a698df40 with status ACTIVE [ 1012.277097] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.277266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.277306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.277500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.277586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.277773] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.277869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.277935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.278977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.278977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.278977] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.278977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.278977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.278977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.278977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.278977] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5044ec6d-3a4d-4012-b40f-d147a698df40 is going to be updated. [ 1012.302655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.303562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.303650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.303911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.304074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.304271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5044ec6d-3a4d-4012-b40f-d147a698df40" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.461987] env[69358]: INFO networking_nsxv3.common.synchronization [req-8a88913f-570f-4ee2-8c84-67f5a89c09b2 req-666fa382-478f-4a60-afbe-9093a0ab80e7 tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1012.462635] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1012.462815] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.462934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.463013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.463694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.463862] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.463968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.464047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.464205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.464291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.464387] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.931154] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-570 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.931154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-570" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.931154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-570" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.931154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-570" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.931154] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.931154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.931154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.932212] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.932499] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.932932] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.933438] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.933688] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.934166] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.934499] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.940030] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.940030] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.955763] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.956117] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1012.956438] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.956743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-570" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.958036] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-d11ced64-d501-4729-8060-f95b71050ea8 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.958036] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.958036] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.958036] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.958452] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11ced64-d501-4729-8060-f95b71050ea8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.968163] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.968163] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.968163] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf already deleted. [ 1012.968163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.268482] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: SUCCESS [ 1013.268787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.268912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.269167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.270198] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.271230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.271230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.271230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.271230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.271230] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.388019] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c475f0d3-7e5d-4bc8-9e04-2bd7a6eddc4d None None] Enqueued Resource ID: 38404258-04ec-444a-8db6-dd2e0f1bfe3d with Priority: HIGHEST for action port [ 1013.388019] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38404258-04ec-444a-8db6-dd2e0f1bfe3d with Priority: HIGHEST for action port [ 1013.388286] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-38404258-04ec-444a-8db6-dd2e0f1bfe3d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.388354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38404258-04ec-444a-8db6-dd2e0f1bfe3d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.388388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38404258-04ec-444a-8db6-dd2e0f1bfe3d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.388676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38404258-04ec-444a-8db6-dd2e0f1bfe3d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.388712] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38404258-04ec-444a-8db6-dd2e0f1bfe3d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.461737] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.462540] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.462717] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.462998] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.463173] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.463329] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port d11ced64-d501-4729-8060-f95b71050ea8 not found, creating... [ 1013.463598] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.463762] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.465468] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.465468] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.465468] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.465468] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.465468] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.465468] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.466014] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.466014] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.466014] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: d11ced64-d501-4729-8060-f95b71050ea8 is going to be created. [ 1013.487165] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.487165] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.487440] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.487511] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.487750] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.487989] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.776456] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.898487] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38404258-04ec-444a-8db6-dd2e0f1bfe3d [ 1013.898487] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.898487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.898487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.898487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.898487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.898487] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38404258-04ec-444a-8db6-dd2e0f1bfe3d already deleted. [ 1013.898487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38404258-04ec-444a-8db6-dd2e0f1bfe3d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.062174] env[69358]: INFO networking_nsxv3.common.synchronization [req-f1d77e5b-eabc-4380-96a5-f678eab86cf0 req-fd34a75c-ecd4-4e1b-b7fc-32650e1d82b6 tempest-ServersV294TestFqdnHostnames-1528970364 tempest-ServersV294TestFqdnHostnames-1528970364-project-member] Enqueued Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_members [ 1014.063226] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGHEST for action security_group_members [ 1014.063466] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2c85ab1-5f4b-4878-9858-c616793b3b32 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.064037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.064037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.064037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.064037] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.064199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.064324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.064435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.064545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.064662] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.212925] env[69358]: INFO networking_nsxv3.common.synchronization [req-8a88913f-570f-4ee2-8c84-67f5a89c09b2 req-66bb6975-f429-4400-9234-9d901664b2ba service nova] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 1014.213184] env[69358]: INFO networking_nsxv3.common.synchronization [req-8a88913f-570f-4ee2-8c84-67f5a89c09b2 req-66bb6975-f429-4400-9234-9d901664b2ba service nova] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1014.213395] env[69358]: INFO networking_nsxv3.common.synchronization [req-8a88913f-570f-4ee2-8c84-67f5a89c09b2 req-66bb6975-f429-4400-9234-9d901664b2ba service nova] Enqueued Resource ID: d11ced64-d501-4729-8060-f95b71050ea8 with Priority: HIGHEST for action port [ 1014.216726] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 1014.216846] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1014.216976] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ced64-d501-4729-8060-f95b71050ea8 with Priority: HIGHEST for action port [ 1014.217319] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.217476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.217560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.217890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.217986] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.219132] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.219132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.219132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.219298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.219555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.219555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.219662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.219802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.220081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.220081] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.226146] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d11ced64-d501-4729-8060-f95b71050ea8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.226146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.226146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.226146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.226146] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11ced64-d501-4729-8060-f95b71050ea8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.279824] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.569029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.569029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.569029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.569029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.569029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.569029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.569029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.569029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.569029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.569029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.569029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 is going to be updated. [ 1014.592753] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.592884] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.592957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.593411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.593556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.604644] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 in Status: IN_PROGRESS for 2s [ 1014.727143] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.728504] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.728504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.728669] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d11ced64-d501-4729-8060-f95b71050ea8 with status ACTIVE [ 1014.728669] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.728809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.728855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.729066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.729155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.729322] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.729567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.729567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.729756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.729756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.729887] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.729947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.730025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.732536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.732706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.732788] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d11ced64-d501-4729-8060-f95b71050ea8 is going to be updated. [ 1014.737335] env[69358]: INFO networking_nsxv3.common.synchronization [req-a8dc4652-a198-491f-a925-f30a70de9b90 req-aaed9d2c-d57d-4b1f-9f31-f0b5f6b71f26 tempest-AttachVolumeShelveTestJSON-2021849226 tempest-AttachVolumeShelveTestJSON-2021849226-project-member] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_members [ 1014.737544] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_members [ 1014.738505] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.738646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.738719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.738911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.740850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.740962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.741032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.741199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.741284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.741376] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.753536] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.753536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.753536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.753536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.753767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.754193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.778315] env[69358]: INFO networking_nsxv3.common.synchronization [req-e76ecade-480b-4fe0-9722-790098d8d5b7 req-4b2b20ab-f86a-4432-87bb-182a6307f7fd tempest-ServerActionsTestOtherB-1009679498 tempest-ServerActionsTestOtherB-1009679498-project-member] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1014.780165] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1014.781283] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.781549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.782237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.782674] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.782920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.783141] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab is going to be updated. [ 1014.785054] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.785301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.785480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.785729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.785975] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.786262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.787120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.787120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.787120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.787120] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.822389] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.822514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.822609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.822782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.822924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.834546] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: IN_PROGRESS for 2s [ 1015.223210] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-866 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.223534] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.223574] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.224300] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.224300] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.224451] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.224451] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.224654] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.224801] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.225015] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.225135] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.225246] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.225448] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.225516] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.225580] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.225701] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.234979] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.245071] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.245071] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.245071] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada already deleted. [ 1015.245071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.245673] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.245841] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.245979] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.247022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.247265] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-1938e39c-0709-4420-a5e2-70a0285228a6 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.247444] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.247567] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.247854] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.248011] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1938e39c-0709-4420-a5e2-70a0285228a6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.290265] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.290408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.290478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.291387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.291387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.291387] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.291387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.291387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.291387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.291387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.291690] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1015.315724] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.315854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.315923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.316140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.316451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.323902] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1015.739696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.739857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.739930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.740182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.740289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.740393] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf is going to be created. [ 1015.750899] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.751194] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.751322] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.751671] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.751825] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.751984] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 1938e39c-0709-4420-a5e2-70a0285228a6 not found, creating... [ 1015.752275] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.753028] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.753028] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.753028] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.753028] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.753291] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.753473] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.753601] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.753830] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.753996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.754174] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 1938e39c-0709-4420-a5e2-70a0285228a6 is going to be created. [ 1015.792534] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.792886] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.793084] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.793470] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.793646] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.793890] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.798550] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.798734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.798805] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.799750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.799750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.807615] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: UNINITIALIZED for 2s [ 1016.577568] env[69358]: INFO networking_nsxv3.common.synchronization [req-a8dc4652-a198-491f-a925-f30a70de9b90 req-186a0a4d-d1f3-4203-8f82-21063310707a service nova] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_rules [ 1016.577568] env[69358]: INFO networking_nsxv3.common.synchronization [req-a8dc4652-a198-491f-a925-f30a70de9b90 req-186a0a4d-d1f3-4203-8f82-21063310707a service nova] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_members [ 1016.577568] env[69358]: INFO networking_nsxv3.common.synchronization [req-a8dc4652-a198-491f-a925-f30a70de9b90 req-186a0a4d-d1f3-4203-8f82-21063310707a service nova] Enqueued Resource ID: 1938e39c-0709-4420-a5e2-70a0285228a6 with Priority: HIGHEST for action port [ 1016.578437] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_rules [ 1016.578635] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_members [ 1016.578748] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1938e39c-0709-4420-a5e2-70a0285228a6 with Priority: HIGHEST for action port [ 1016.579079] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.579199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.579272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.579476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.579558] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.583979] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.583979] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.583979] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.583979] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-1938e39c-0709-4420-a5e2-70a0285228a6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.583979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.583979] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1938e39c-0709-4420-a5e2-70a0285228a6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.613561] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 in Status: SUCCESS [ 1016.613561] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 deletion is rescheduled due to dependency. [ 1016.613561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.845937] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: SUCCESS [ 1016.845937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.846301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.847554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.847554] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.847554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.847554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.847798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.847852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.847957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.848530] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.010446] env[69358]: INFO networking_nsxv3.common.synchronization [req-f0af5815-2580-4a2d-9ab8-f7ff967f200c req-47237a10-dc84-4eb9-851b-2805693bbe25 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 1017.011200] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 1017.011624] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.011796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.011851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.012188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.012363] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.012511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.012568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.012749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.012837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.012989] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.085426] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1938e39c-0709-4420-a5e2-70a0285228a6 with status ACTIVE [ 1017.085426] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.085736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.085736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.085937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.086040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.086265] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.086403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.086488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.086645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.086755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.087030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.087201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.087201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.087362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.087444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.087520] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1938e39c-0709-4420-a5e2-70a0285228a6 is going to be updated. [ 1017.089337] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.089531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.089728] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.115730] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.115730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.115730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.115924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.116603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.116603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.334191] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1017.334471] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b deletion is rescheduled due to dependency. [ 1017.334553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.350249] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.350420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.350525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.350750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.350923] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.351062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.351129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.351286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.351373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.351467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.351614] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.351705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.351756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.351899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.352049] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.352174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.352251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.352420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.352517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.352618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.352729] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.515379] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.515602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.515602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.515949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.515949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.516106] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.516208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.516285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.516418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.516592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.516752] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be updated. [ 1017.541936] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.542119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.542162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.542390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.542529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.549983] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: IN_PROGRESS for 2s [ 1017.596029] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.815814] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: SUCCESS [ 1017.816115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.816189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.817121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.817121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.817121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.817121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.817121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.817121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.817121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.817543] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.856029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72792bb3-b78f-4b14-80d7-1253aec704ab: rpc.has_security_group_logging(os_id): False [ 1017.871957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.872094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.872140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.872378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.872490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.872696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.872823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.872885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.873073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.873173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.873346] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.873457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.873532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.873676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.874423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.874423] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.874423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.874423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.874423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.874423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.874806] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab is going to be updated. [ 1017.931197] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.931397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.931495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.931733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.931882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.943081] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: IN_PROGRESS for 2s [ 1018.099348] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.099519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.099585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.099799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.099895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.099985] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada is going to be created. [ 1018.113842] env[69358]: INFO networking_nsxv3.common.synchronization [None req-aed9c014-32c5-4ba0-907c-697ccf8215c7 tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: ee42709e-8090-4017-b42d-0a4c13ff3dd6 with Priority: HIGHEST for action security_group_rules [ 1018.114435] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee42709e-8090-4017-b42d-0a4c13ff3dd6 with Priority: HIGHEST for action security_group_rules [ 1018.114814] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.114814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.115084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.115164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.115227] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee42709e-8090-4017-b42d-0a4c13ff3dd6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.124553] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.124553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.124553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.124553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.124553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.130732] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: UNINITIALIZED for 2s [ 1018.178462] env[69358]: INFO networking_nsxv3.common.synchronization [None req-92c07642-25d1-4f3a-8358-d3d8fc82eef7 tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: ee42709e-8090-4017-b42d-0a4c13ff3dd6 with Priority: HIGHEST for action security_group_rules [ 1018.179091] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee42709e-8090-4017-b42d-0a4c13ff3dd6 with Priority: HIGHEST for action security_group_rules [ 1018.179294] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.179453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.318811] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.633916] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.634208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.634291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.634609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.634786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.634919] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee42709e-8090-4017-b42d-0a4c13ff3dd6 already deleted. [ 1018.635093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.635540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.635540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.635656] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee42709e-8090-4017-b42d-0a4c13ff3dd6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.821736] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9000b38-d75e-47e3-86fe-4cd98fcbfecf: rpc.has_security_group_logging(os_id): False [ 1018.843639] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.843805] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.843927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.844128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.844218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.844459] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.844622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.844658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.844837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.844998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.845122] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf is going to be created. [ 1018.906696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.906696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.906696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.907104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.907104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.916648] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: IN_PROGRESS for 2s [ 1019.158733] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.158733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.158733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.158733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.158733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.158733] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee42709e-8090-4017-b42d-0a4c13ff3dd6 already deleted. [ 1019.158733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee42709e-8090-4017-b42d-0a4c13ff3dd6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.559514] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: SUCCESS [ 1019.559514] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 deletion is rescheduled due to dependency. [ 1019.559514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.955652] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: SUCCESS [ 1019.955959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.139839] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: UNINITIALIZED for 4s [ 1020.938391] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: SUCCESS [ 1020.938391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.314397] env[69358]: INFO networking_nsxv3.common.synchronization [req-57d1a153-c837-4ea6-a9e7-04fc7bc13e82 req-3f3aeec0-4440-4860-ba28-b1a33f5957dc tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1021.315048] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1021.315323] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.315452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.315521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.315733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.315887] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.315987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.316660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.316892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.317014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.317128] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.820615] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.820815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.820883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.821111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.821207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.821402] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.821520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.821582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.821799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.821888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.821978] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1021.849098] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.850776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.850896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.851209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.851451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.859271] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1021.994955] env[69358]: INFO networking_nsxv3.common.synchronization [req-2f72ab95-99a0-4cbd-b16c-937beb474b7e req-20b1dc10-fcde-471c-88d6-0bd462e4798b tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_members [ 1021.995844] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_members [ 1021.996131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.996296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.996391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.996700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.996900] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.997066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.997152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.997343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.997447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.997570] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.155101] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: SUCCESS [ 1022.155377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.155560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.155787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.155986] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.156128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.156210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.156384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.156468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.156552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.156648] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.439313] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.440505] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.440765] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.442142] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.442588] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.443456] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.443802] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.444472] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.444745] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.445207] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.445655] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.445902] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.447220] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.447220] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.447220] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.447220] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.464918] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.466081] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.466081] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.466272] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.466739] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-53ffde16-6c2a-4994-847c-107100da0e13 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.467945] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-53ffde16-6c2a-4994-847c-107100da0e13" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.467945] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-53ffde16-6c2a-4994-847c-107100da0e13" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.468965] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-53ffde16-6c2a-4994-847c-107100da0e13" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.468965] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ffde16-6c2a-4994-847c-107100da0e13',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.499601] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.499804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.499855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.500095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.500202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.500448] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.500517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.500555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.500703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.500777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.500862] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 already deleted. [ 1022.500957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.661176] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.971913] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.972177] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.972313] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.972610] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.972763] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.972922] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 53ffde16-6c2a-4994-847c-107100da0e13 not found, creating... [ 1022.973196] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.973379] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.973504] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.973726] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.973882] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.974185] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.974599] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.974806] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.975109] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.975318] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.975512] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 53ffde16-6c2a-4994-847c-107100da0e13 is going to be created. [ 1022.994064] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.994064] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.994397] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.994669] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.994957] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.995278] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-53ffde16-6c2a-4994-847c-107100da0e13" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.163902] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6bcbfacc-e75b-4ac4-81ab-350530d27ada: rpc.has_security_group_logging(os_id): False [ 1023.183035] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.183221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.183291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.183523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.183631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.184287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.184287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.184287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.184636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.184636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.184636] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada is going to be created. [ 1023.256243] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.256407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.256468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.256665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.256852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.267468] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: IN_PROGRESS for 2s [ 1023.857078] env[69358]: INFO networking_nsxv3.common.synchronization [req-2f72ab95-99a0-4cbd-b16c-937beb474b7e req-1650401d-c293-4915-a9e1-8bccb17352f1 service nova] Enqueued Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_rules [ 1023.857390] env[69358]: INFO networking_nsxv3.common.synchronization [req-2f72ab95-99a0-4cbd-b16c-937beb474b7e req-1650401d-c293-4915-a9e1-8bccb17352f1 service nova] Enqueued Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_members [ 1023.857524] env[69358]: INFO networking_nsxv3.common.synchronization [req-2f72ab95-99a0-4cbd-b16c-937beb474b7e req-1650401d-c293-4915-a9e1-8bccb17352f1 service nova] Enqueued Resource ID: 53ffde16-6c2a-4994-847c-107100da0e13 with Priority: HIGHEST for action port [ 1023.857693] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_rules [ 1023.857867] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_members [ 1023.857992] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53ffde16-6c2a-4994-847c-107100da0e13 with Priority: HIGHEST for action port [ 1023.858746] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.858899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.858988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.859227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.859376] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.860947] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.860947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.860947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.860947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.860947] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.860947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.860947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.861404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.861404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.861404] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.862225] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-53ffde16-6c2a-4994-847c-107100da0e13 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.862338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53ffde16-6c2a-4994-847c-107100da0e13" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.862406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53ffde16-6c2a-4994-847c-107100da0e13" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.862562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53ffde16-6c2a-4994-847c-107100da0e13" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.862637] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ffde16-6c2a-4994-847c-107100da0e13',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.872162] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1023.872362] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 1023.872471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.364767] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.364968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.365172] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.366038] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53ffde16-6c2a-4994-847c-107100da0e13 with status ACTIVE [ 1024.366233] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.366342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.366410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.366660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.366792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.366859] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.366936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.367037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.367195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.367297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.367484] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.367596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.367668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.367767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.367840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.367997] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53ffde16-6c2a-4994-847c-107100da0e13 is going to be updated. [ 1024.396134] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.396410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.396410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.396541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.396673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.396832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53ffde16-6c2a-4994-847c-107100da0e13" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.781452] env[69358]: INFO networking_nsxv3.common.synchronization [req-a4872384-8de1-429c-a57a-661a0ea701f1 req-7502f7da-328f-48db-a5e6-0ec9483a4fc5 tempest-TenantUsagesTestJSON-2047618912 tempest-TenantUsagesTestJSON-2047618912-project-member] Enqueued Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGHEST for action security_group_members [ 1024.783400] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGHEST for action security_group_members [ 1024.783400] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59601c-f6bf-486f-a60f-b19e02c39dbe taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.783400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.783400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.783400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.783400] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.786733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.786852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.787833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.788061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.788212] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.877096] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.278632] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: SUCCESS [ 1025.278864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.292467] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.292628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.292704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.292940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.293069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.293216] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.293316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.293379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.293619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.293619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.293709] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe already deleted. [ 1025.293753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.384355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.384475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.386323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.386323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.386323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.386323] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 is going to be created. [ 1025.415984] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.416150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.416266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.416467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.416738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.422192] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.422192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.422192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.422192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.422192] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.422192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.422192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.422192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.422192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.423906] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.423906] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.423906] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.423906] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.423906] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.423906] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.423906] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.426692] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 in Status: UNINITIALIZED for 2s [ 1025.440159] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.440879] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1025.441885] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.441885] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.441885] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-69ecef35-3bb7-4e99-8404-502ce33dc7e8 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.441885] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-69ecef35-3bb7-4e99-8404-502ce33dc7e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.442310] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-69ecef35-3bb7-4e99-8404-502ce33dc7e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.442310] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-69ecef35-3bb7-4e99-8404-502ce33dc7e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.442374] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ecef35-3bb7-4e99-8404-502ce33dc7e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.945703] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.945988] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.946100] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.946529] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.946803] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.947086] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 69ecef35-3bb7-4e99-8404-502ce33dc7e8 not found, creating... [ 1025.947475] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.947746] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.947940] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.948303] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.948525] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.948966] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.949247] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.949460] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.949779] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.949997] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.950236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 69ecef35-3bb7-4e99-8404-502ce33dc7e8 is going to be created. [ 1025.969128] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.969383] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.969535] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.969821] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.970064] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.970365] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-69ecef35-3bb7-4e99-8404-502ce33dc7e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.810041] env[69358]: INFO networking_nsxv3.common.synchronization [req-a4872384-8de1-429c-a57a-661a0ea701f1 req-064fe15f-22a5-4122-a4c4-fd6cbe761a23 service nova] Enqueued Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGHEST for action security_group_rules [ 1026.810236] env[69358]: INFO networking_nsxv3.common.synchronization [req-a4872384-8de1-429c-a57a-661a0ea701f1 req-064fe15f-22a5-4122-a4c4-fd6cbe761a23 service nova] Enqueued Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGHEST for action security_group_members [ 1026.810377] env[69358]: INFO networking_nsxv3.common.synchronization [req-a4872384-8de1-429c-a57a-661a0ea701f1 req-064fe15f-22a5-4122-a4c4-fd6cbe761a23 service nova] Enqueued Resource ID: 69ecef35-3bb7-4e99-8404-502ce33dc7e8 with Priority: HIGHEST for action port [ 1026.810639] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGHEST for action security_group_rules [ 1026.810801] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGHEST for action security_group_members [ 1026.810922] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ecef35-3bb7-4e99-8404-502ce33dc7e8 with Priority: HIGHEST for action port [ 1026.811894] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.812054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.812129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.812470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.812531] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.813349] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59601c-f6bf-486f-a60f-b19e02c39dbe taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.813504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.813590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.813766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.813915] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.814092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.814147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.814291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.814380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.814473] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.815327] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-69ecef35-3bb7-4e99-8404-502ce33dc7e8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.815429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69ecef35-3bb7-4e99-8404-502ce33dc7e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.815429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69ecef35-3bb7-4e99-8404-502ce33dc7e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.815554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69ecef35-3bb7-4e99-8404-502ce33dc7e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.815627] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ecef35-3bb7-4e99-8404-502ce33dc7e8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.132363] env[69358]: INFO networking_nsxv3.common.synchronization [req-d406f740-049a-459a-8d5e-30c1975914ba req-4bbaa1cd-8df6-42b8-a217-edac405cde21 tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 1027.132363] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 1027.132363] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.132363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.132363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.132965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.133256] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.133473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.133618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.133852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.134046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.134225] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.317217] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59601c-f6bf-486f-a60f-b19e02c39dbe taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.317391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.317584] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.319331] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69ecef35-3bb7-4e99-8404-502ce33dc7e8 with status ACTIVE [ 1027.319514] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.322556] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.322556] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.322556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.322556] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69ecef35-3bb7-4e99-8404-502ce33dc7e8 is going to be updated. [ 1027.341081] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.342528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.342528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.342528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.342528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.342528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69ecef35-3bb7-4e99-8404-502ce33dc7e8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.435054] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 in Status: SUCCESS [ 1027.435292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.435444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.435650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.435831] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.435941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.436015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.436159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.436234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.436313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.436399] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.463463] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.463675] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.463809] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.464162] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.464465] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.464750] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.464861] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.467026] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.467026] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.467026] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.467026] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.467026] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.467026] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.467026] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.467026] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.467026] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.485256] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.485433] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.485580] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.485748] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-895" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.486080] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-5cabb608-a1bc-4488-bd29-f97a8f51d698 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.486271] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-5cabb608-a1bc-4488-bd29-f97a8f51d698" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.486399] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-5cabb608-a1bc-4488-bd29-f97a8f51d698" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.486712] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-5cabb608-a1bc-4488-bd29-f97a8f51d698" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.486851] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cabb608-a1bc-4488-bd29-f97a8f51d698',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.637159] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.637159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.637159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.637429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.637582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.637806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.637938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.638065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.638341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.638387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.638490] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 1027.672830] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.672830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.672830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.672830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.672830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.680265] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 1027.819918] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.939449] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.994295] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.994295] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.994295] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.994295] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.994295] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.994295] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 5cabb608-a1bc-4488-bd29-f97a8f51d698 not found, creating... [ 1027.994295] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.994295] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.994295] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.994295] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.994295] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.994756] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.994756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.994756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.994756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.994756] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.995292] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 5cabb608-a1bc-4488-bd29-f97a8f51d698 is going to be created. [ 1028.015714] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.015714] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.015714] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.015714] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.015714] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.015714] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-5cabb608-a1bc-4488-bd29-f97a8f51d698" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.325891] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.326212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.326212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.326334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.326425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.326523] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe is going to be created. [ 1028.348617] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.348735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.348794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.348941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.349099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.356680] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe in Status: UNINITIALIZED for 2s [ 1028.442212] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ea3bd4d-789d-41ef-b939-e3909d5d52e9: rpc.has_security_group_logging(os_id): False [ 1028.459916] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.460095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.460162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.460351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.460441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.460684] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.460800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.460858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.460983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.461068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.461156] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 is going to be created. [ 1028.514440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.514612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.514756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.514976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.515253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.524868] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 in Status: IN_PROGRESS for 2s [ 1028.739970] env[69358]: INFO networking_nsxv3.common.synchronization [req-d406f740-049a-459a-8d5e-30c1975914ba req-e4d7edd7-b840-4ea7-ad9f-c8062f84b019 service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 1028.740262] env[69358]: INFO networking_nsxv3.common.synchronization [req-d406f740-049a-459a-8d5e-30c1975914ba req-e4d7edd7-b840-4ea7-ad9f-c8062f84b019 service nova] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 1028.740477] env[69358]: INFO networking_nsxv3.common.synchronization [req-d406f740-049a-459a-8d5e-30c1975914ba req-e4d7edd7-b840-4ea7-ad9f-c8062f84b019 service nova] Enqueued Resource ID: 5cabb608-a1bc-4488-bd29-f97a8f51d698 with Priority: HIGHEST for action port [ 1028.741349] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_rules [ 1028.741591] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 1028.741775] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cabb608-a1bc-4488-bd29-f97a8f51d698 with Priority: HIGHEST for action port [ 1028.742234] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.742445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.742593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.742899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.743074] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.744984] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.746086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.746462] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cabb608-a1bc-4488-bd29-f97a8f51d698 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.746671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cabb608-a1bc-4488-bd29-f97a8f51d698" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.746802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cabb608-a1bc-4488-bd29-f97a8f51d698" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.748179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cabb608-a1bc-4488-bd29-f97a8f51d698" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.748302] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cabb608-a1bc-4488-bd29-f97a8f51d698',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.250804] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.250804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.251062] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cabb608-a1bc-4488-bd29-f97a8f51d698 with status ACTIVE [ 1029.251062] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.251153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.251213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.251491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.251491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.251789] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.251789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.251883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.251958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.252049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.252241] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.252329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.252388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.252524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.252601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.252682] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cabb608-a1bc-4488-bd29-f97a8f51d698 is going to be updated. [ 1029.273673] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.273828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.273869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.274059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.274189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.274349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cabb608-a1bc-4488-bd29-f97a8f51d698" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.689149] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 1029.689492] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 deletion is rescheduled due to dependency. [ 1029.689777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.689866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.690354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.690354] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.690478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.690478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.690606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.690682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.691187] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.788640] env[69358]: INFO networking_nsxv3.common.synchronization [req-d72ded7e-0471-4c0b-b891-41a835c917e1 req-4fa3e782-170c-4402-a6d0-bb8588ada8c5 tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1029.789928] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1029.790288] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.790413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.790478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.790675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.790826] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.791443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.791443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.791443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.791443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.791443] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.195418] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.226057] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.226057] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.226057] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.226562] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.226970] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.227503] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.227764] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.228143] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.228444] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.228805] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.229312] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.229587] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.231016] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.231016] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.231016] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.231016] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.251038] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.251038] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.251038] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.251038] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.251038] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-978330b9-d618-4f75-91a4-e30854c51597 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.251038] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-978330b9-d618-4f75-91a4-e30854c51597" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.251038] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-978330b9-d618-4f75-91a4-e30854c51597" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.251038] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-978330b9-d618-4f75-91a4-e30854c51597" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.251038] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('978330b9-d618-4f75-91a4-e30854c51597',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.297435] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.366968] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe in Status: SUCCESS [ 1030.366968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.366968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.366968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.367271] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.367271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.367271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.367416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.367560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.367605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.367749] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.536044] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 in Status: SUCCESS [ 1030.536298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.697997] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.754053] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.754231] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.754231] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.754508] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.754663] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.754826] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 978330b9-d618-4f75-91a4-e30854c51597 not found, creating... [ 1030.755109] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.755278] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.755403] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.755699] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.755863] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.756166] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.756328] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.756451] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.756669] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.756808] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.756952] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 978330b9-d618-4f75-91a4-e30854c51597 is going to be created. [ 1030.774480] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.774657] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.774785] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.775037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.775271] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.775490] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-978330b9-d618-4f75-91a4-e30854c51597" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.799161] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.870814] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59601c-f6bf-486f-a60f-b19e02c39dbe taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.870814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.871088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.871088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.871260] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.871399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.871460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.871572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.871667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.871744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.871888] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59601c-f6bf-486f-a60f-b19e02c39dbe taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.871992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.872050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.872201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.872335] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.872433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.872492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.872611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.872725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.872812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.873012] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.204248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.204438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.204513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.204742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.204837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.204941] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 1031.255914] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.256257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.256257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.256530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.256746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.265656] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 1031.302014] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.302014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.302014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.302242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.302299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.302446] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1031.349526] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.349685] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.349760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.349989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.350174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.365058] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1031.376097] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c59601c-f6bf-486f-a60f-b19e02c39dbe: rpc.has_security_group_logging(os_id): False [ 1031.406502] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.406879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.406879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.407032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.407032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.407319] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.407434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.407800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.407800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.407800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.407948] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.407948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.408082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.408214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.408283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.408441] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.408540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.408613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.408727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.408798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.408874] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe is going to be created. [ 1031.472703] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.472888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.472944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.473214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.473300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.487502] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe in Status: IN_PROGRESS for 2s [ 1031.518328] env[69358]: INFO networking_nsxv3.common.synchronization [req-d72ded7e-0471-4c0b-b891-41a835c917e1 req-94fe3b07-1642-4e33-8d5d-82d97bcb7210 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 1031.519210] env[69358]: INFO networking_nsxv3.common.synchronization [req-d72ded7e-0471-4c0b-b891-41a835c917e1 req-94fe3b07-1642-4e33-8d5d-82d97bcb7210 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1031.519466] env[69358]: INFO networking_nsxv3.common.synchronization [req-d72ded7e-0471-4c0b-b891-41a835c917e1 req-94fe3b07-1642-4e33-8d5d-82d97bcb7210 service nova] Enqueued Resource ID: 978330b9-d618-4f75-91a4-e30854c51597 with Priority: HIGHEST for action port [ 1031.520244] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 1031.520436] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1031.521058] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 978330b9-d618-4f75-91a4-e30854c51597 with Priority: HIGHEST for action port [ 1031.521058] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.521230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.521230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.521866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.521866] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.522937] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.522937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.523135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-978330b9-d618-4f75-91a4-e30854c51597 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.523220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-978330b9-d618-4f75-91a4-e30854c51597" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.527062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-978330b9-d618-4f75-91a4-e30854c51597" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.527062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-978330b9-d618-4f75-91a4-e30854c51597" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.527062] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('978330b9-d618-4f75-91a4-e30854c51597',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.029234] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.029603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.029603] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 978330b9-d618-4f75-91a4-e30854c51597 with status ACTIVE [ 1032.029803] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.029888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.029948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.030148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.030252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.030525] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.030635] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.030696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.030861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.032228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.032228] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.032228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.032228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.032228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.032228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.032228] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 978330b9-d618-4f75-91a4-e30854c51597 is going to be updated. [ 1032.054380] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.054380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.054550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.054639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.054739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.054892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-978330b9-d618-4f75-91a4-e30854c51597" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.277654] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 1033.277654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.277654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.277654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.277654] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.277654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.277654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.277654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.277654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.277654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.277654] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.377115] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1033.377115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.377115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.377115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.377115] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.377115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.377115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.377115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.377115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.377115] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.503440] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe in Status: SUCCESS [ 1033.503440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.784500] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.784803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.784803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.784935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.785131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.785251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.785348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.785675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.785813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.785893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.786022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.786135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.786211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.786298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.786649] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.786765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.786857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.786943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.787025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.787168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.787289] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.880263] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.289540] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e45a41dd-b21d-4639-af89-ce7883a3d987: rpc.has_security_group_logging(os_id): False [ 1034.311335] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.311492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.314019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.314019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.314019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.314019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.314608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.314608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.314608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.314608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.314608] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 1034.331998] env[69358]: INFO networking_nsxv3.common.synchronization [req-29ffb67a-f22d-4b1f-8500-4f8c59d906ac req-7fe0a082-2f6d-41d1-9a74-b289e9604ba1 tempest-ListImageFiltersTestJSON-1857961629 tempest-ListImageFiltersTestJSON-1857961629-project-member] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1034.332600] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1034.332978] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.333122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.333164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.334208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.334208] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.334208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.334208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.334208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.334208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.334208] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.367875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.368030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.368119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.368339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.368515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.378065] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 1034.381812] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.629438] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.629673] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.630089] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.630445] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.630768] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.631011] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.631169] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.631406] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.631557] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.631978] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.632113] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.632227] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.632340] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.632453] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.632559] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.632697] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.651556] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.651758] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1034.651909] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.652239] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.652556] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a363e113-1965-4b65-982e-865b29040886 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.652789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a363e113-1965-4b65-982e-865b29040886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.652957] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a363e113-1965-4b65-982e-865b29040886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.653390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a363e113-1965-4b65-982e-865b29040886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.653543] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a363e113-1965-4b65-982e-865b29040886',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.836083] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.836288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.836343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.836530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.836624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.836815] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.836911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.836968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.837131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.837243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.837329] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb already deleted. [ 1034.837411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.886466] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.886649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.886700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.886869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.886957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.887070] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1034.919011] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.919201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.919274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.919428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.919589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.930857] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1035.215489] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.215489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.215489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.215489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.215489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.215489] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a363e113-1965-4b65-982e-865b29040886 not found, creating... [ 1035.215489] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.215489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.215489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.215489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.215489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.217023] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.217023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.217023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.217023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.217023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.217023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a363e113-1965-4b65-982e-865b29040886 is going to be created. [ 1035.217023] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.217023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.217023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.217542] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.217542] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.217542] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a363e113-1965-4b65-982e-865b29040886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.005220] env[69358]: INFO networking_nsxv3.common.synchronization [req-29ffb67a-f22d-4b1f-8500-4f8c59d906ac req-b3f8dfff-4dfd-4ae0-869e-99560380ca43 service nova] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_rules [ 1036.005220] env[69358]: INFO networking_nsxv3.common.synchronization [req-29ffb67a-f22d-4b1f-8500-4f8c59d906ac req-b3f8dfff-4dfd-4ae0-869e-99560380ca43 service nova] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1036.005220] env[69358]: INFO networking_nsxv3.common.synchronization [req-29ffb67a-f22d-4b1f-8500-4f8c59d906ac req-b3f8dfff-4dfd-4ae0-869e-99560380ca43 service nova] Enqueued Resource ID: a363e113-1965-4b65-982e-865b29040886 with Priority: HIGHEST for action port [ 1036.005220] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_rules [ 1036.005220] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1036.005220] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a363e113-1965-4b65-982e-865b29040886 with Priority: HIGHEST for action port [ 1036.005220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.005220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.005220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.006066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.006255] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.007176] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.007558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.007760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.008051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.008314] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.008592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.008790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.009078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.009521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.010551] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.010965] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a363e113-1965-4b65-982e-865b29040886 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.011237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a363e113-1965-4b65-982e-865b29040886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.011415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a363e113-1965-4b65-982e-865b29040886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.011732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a363e113-1965-4b65-982e-865b29040886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.011905] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a363e113-1965-4b65-982e-865b29040886',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.391659] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 1036.391966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.513729] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.514910] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.515141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.515222] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a363e113-1965-4b65-982e-865b29040886 with status ACTIVE [ 1036.515787] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.515787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.515787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.515787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.516075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.516075] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.516385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.516385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.516385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.516568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.516734] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.516987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.517423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.517866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.517866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.517866] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a363e113-1965-4b65-982e-865b29040886 is going to be updated. [ 1036.538059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.538228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.538324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.538559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.538722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.538917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a363e113-1965-4b65-982e-865b29040886" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.941171] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1036.941307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.941446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.941687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.941879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.941996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.942090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.942235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.942306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.942426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.942624] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.019647] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.063785] env[69358]: INFO networking_nsxv3.common.synchronization [req-b8470dc5-6663-493a-b81a-215521878566 req-629ccc9f-2cda-460d-836a-2ba564642d69 tempest-ServerRescueTestJSON-24232825 tempest-ServerRescueTestJSON-24232825-project-member] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 1037.063785] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 1037.064072] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.064072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.064195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.064358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.064555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.064682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.064777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.064953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.065081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.065219] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.445035] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.445210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.445304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.445500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.445747] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.445853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.445920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.446109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.446186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.446274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.446422] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.446515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.446615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.446749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.446905] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.447046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.447091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.447234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.447319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.447428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.447508] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.522530] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.522791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.522791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.523015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.523131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.523246] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb is going to be created. [ 1037.545430] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.545647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.545647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.545841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.545991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.555249] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: UNINITIALIZED for 2s [ 1037.566569] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.950466] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 1037.969439] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.969439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.969439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.969439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.969439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.969439] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.969439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.969439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.969439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.969439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.969439] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.970152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.970318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.970681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.970898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.971563] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.971794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.972033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.972283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.972521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.972718] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1038.019021] env[69358]: INFO networking_nsxv3.common.synchronization [req-cce0377e-b0ce-4ce4-9c04-beb1676bb875 req-699d8c33-4cf4-426a-bb1d-049ff9cab110 tempest-ListImageFiltersTestJSON-1857961629 tempest-ListImageFiltersTestJSON-1857961629-project-member] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1038.019021] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1038.019021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.019021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.030390] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.030776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.030776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.030892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.030940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.042540] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1038.068693] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.443663] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.443888] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.444030] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.444533] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.444863] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.445050] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.445222] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.445498] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.445683] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.445872] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.445989] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.446120] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.446244] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.446362] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.446465] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.446572] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.463642] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.463642] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1038.463821] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.464104] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-781" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.464425] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-34a69a61-9660-495d-874e-936d44404da5 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.464618] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-34a69a61-9660-495d-874e-936d44404da5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.464849] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-34a69a61-9660-495d-874e-936d44404da5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.465233] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-34a69a61-9660-495d-874e-936d44404da5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.465416] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34a69a61-9660-495d-874e-936d44404da5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.571510] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.571681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.571754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.571979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.572097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.572249] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab is going to be updated. [ 1038.598420] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.598633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.598633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.598839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.598977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.610445] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: IN_PROGRESS for 2s [ 1038.968087] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.968328] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.968493] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.968783] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.968937] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.969173] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 34a69a61-9660-495d-874e-936d44404da5 not found, creating... [ 1038.969930] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.969930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.969930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.969930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.970160] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.970376] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.970524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.970642] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.970851] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.971665] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.971665] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 34a69a61-9660-495d-874e-936d44404da5 is going to be created. [ 1039.000141] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.000141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.000141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.000522] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.000804] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.001055] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-34a69a61-9660-495d-874e-936d44404da5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.565853] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: SUCCESS [ 1039.566220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.566276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.566512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.566707] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.566826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.566892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.567054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.567138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.567223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.567398] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.568391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.568585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.568751] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.568858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.568994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.569404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.569404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.569522] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.854172] env[69358]: INFO networking_nsxv3.common.synchronization [req-cce0377e-b0ce-4ce4-9c04-beb1676bb875 req-2beb5621-ca98-44bb-be6b-9b424d4d3eb9 service nova] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_rules [ 1039.854172] env[69358]: INFO networking_nsxv3.common.synchronization [req-cce0377e-b0ce-4ce4-9c04-beb1676bb875 req-2beb5621-ca98-44bb-be6b-9b424d4d3eb9 service nova] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1039.854325] env[69358]: INFO networking_nsxv3.common.synchronization [req-cce0377e-b0ce-4ce4-9c04-beb1676bb875 req-2beb5621-ca98-44bb-be6b-9b424d4d3eb9 service nova] Enqueued Resource ID: 34a69a61-9660-495d-874e-936d44404da5 with Priority: HIGHEST for action port [ 1039.854557] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_rules [ 1039.854690] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1039.854787] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a69a61-9660-495d-874e-936d44404da5 with Priority: HIGHEST for action port [ 1039.855430] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.855541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.855774] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.855829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.856222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-34a69a61-9660-495d-874e-936d44404da5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.856976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34a69a61-9660-495d-874e-936d44404da5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.856976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34a69a61-9660-495d-874e-936d44404da5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.856976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34a69a61-9660-495d-874e-936d44404da5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.856976] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34a69a61-9660-495d-874e-936d44404da5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.055521] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1040.056238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.075866] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.075978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.076241] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.361221] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34a69a61-9660-495d-874e-936d44404da5 with status ACTIVE [ 1040.365034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.365034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.365034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.365034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.365034] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34a69a61-9660-495d-874e-936d44404da5 is going to be updated. [ 1040.386340] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.386340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.386340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.386340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.386340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.386340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34a69a61-9660-495d-874e-936d44404da5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.489101] env[69358]: INFO networking_nsxv3.common.synchronization [req-0116910b-2331-4182-8557-0efa886f3fb2 req-405c8d34-df4e-4d32-bd12-4708c3d2d455 tempest-MultipleCreateTestJSON-1931979633 tempest-MultipleCreateTestJSON-1931979633-project-member] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1040.489663] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1040.489996] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.490131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.490189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.490457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.490617] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.490715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.490774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.491695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.491695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.491695] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.520250] env[69358]: INFO networking_nsxv3.common.synchronization [req-05f66b40-1b4c-43e5-b325-8706e76a968c req-68f1630c-2f33-4c8b-b11a-5315ef082ad6 tempest-TenantUsagesTestJSON-2047618912 tempest-TenantUsagesTestJSON-2047618912-project-member] Enqueued Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGHEST for action security_group_members [ 1040.521337] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGHEST for action security_group_members [ 1040.522417] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59601c-f6bf-486f-a60f-b19e02c39dbe taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.522606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.522664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.524479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.524730] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.524879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.524974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.525298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.525457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.525650] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.578523] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.619886] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: SUCCESS [ 1040.620232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.963256] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.963489] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.963811] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.964016] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.964426] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.964639] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.964798] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.965071] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.965335] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.965631] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.966621] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.966621] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.966621] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.966621] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.966621] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.966621] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.985081] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.985081] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1040.985081] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.985081] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.985081] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.985081] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.985910] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.985910] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.985910] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7cdec8-a7d5-469a-8a5c-ce55cf60785e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.992910] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.993068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.993124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.993307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.993393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.994191] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.994191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.994191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.994191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.994191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.994191] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 already deleted. [ 1040.994191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.031513] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.031677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.031741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.031965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.032056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.032254] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.032352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.032416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.032560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.032634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.032720] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe is going to be updated. [ 1041.058483] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.058636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.058704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.058917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.059069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.067150] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe in Status: IN_PROGRESS for 2s [ 1041.082110] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.082330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.082330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.082585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.082695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.082780] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb is going to be updated. [ 1041.111734] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.111881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.111954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.112200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.112601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.120379] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: IN_PROGRESS for 2s [ 1041.488886] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.489047] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.489330] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.489541] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.489617] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.489780] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port af7cdec8-a7d5-469a-8a5c-ce55cf60785e not found, creating... [ 1041.490099] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.490255] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.490491] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.490745] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.490956] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.491301] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.491470] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.491597] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.491813] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.491956] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.492195] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: af7cdec8-a7d5-469a-8a5c-ce55cf60785e is going to be created. [ 1041.515516] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.515516] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.515516] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.515516] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.515516] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.515877] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.280683] env[69358]: INFO networking_nsxv3.common.synchronization [req-0116910b-2331-4182-8557-0efa886f3fb2 req-89e6f91b-2ff7-4b92-aaaa-c4d4f6704aaa service nova] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_rules [ 1042.280997] env[69358]: INFO networking_nsxv3.common.synchronization [req-0116910b-2331-4182-8557-0efa886f3fb2 req-89e6f91b-2ff7-4b92-aaaa-c4d4f6704aaa service nova] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1042.281066] env[69358]: INFO networking_nsxv3.common.synchronization [req-0116910b-2331-4182-8557-0efa886f3fb2 req-89e6f91b-2ff7-4b92-aaaa-c4d4f6704aaa service nova] Enqueued Resource ID: af7cdec8-a7d5-469a-8a5c-ce55cf60785e with Priority: HIGHEST for action port [ 1042.281612] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_rules [ 1042.281763] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1042.281855] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af7cdec8-a7d5-469a-8a5c-ce55cf60785e with Priority: HIGHEST for action port [ 1042.282992] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.283176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.283344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.283499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.283610] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.286733] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.286733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.286733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.286733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.286993] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.286993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.286993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.287174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.287330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.287330] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.292020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.292020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.292020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.292020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.292020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7cdec8-a7d5-469a-8a5c-ce55cf60785e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.786863] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.787019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.790871] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.791463] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af7cdec8-a7d5-469a-8a5c-ce55cf60785e with status ACTIVE [ 1042.791678] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.791796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.791883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.792124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.792215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.792413] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.792514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.792577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.792731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.792808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.792985] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.793090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.793152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.793289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.793361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.793444] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af7cdec8-a7d5-469a-8a5c-ce55cf60785e is going to be updated. [ 1042.832380] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.832537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.832606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.832844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.833036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.833209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af7cdec8-a7d5-469a-8a5c-ce55cf60785e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.077274] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe in Status: SUCCESS [ 1043.077477] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe deletion is rescheduled due to dependency. [ 1043.077477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.128920] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: IN_PROGRESS for 4s [ 1043.295445] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.797969] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.798156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.798226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.798454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.798592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.798706] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be created. [ 1043.827131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.827131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.827131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.827131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.827131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.835368] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: UNINITIALIZED for 2s [ 1044.745715] env[69358]: INFO networking_nsxv3.common.synchronization [req-949df690-11fa-4f7c-924b-dea0c26b7010 req-de32f024-013b-44dc-b6df-296fe3339c99 tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1044.749064] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1044.749064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.749064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.749064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.749064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.749064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.749064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.749064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.749064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.749064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.749064] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.139428] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: SUCCESS [ 1045.139809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.140075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.140371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.140660] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.140835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.140972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.141176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.141982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.141982] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.252226] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.647182] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.753409] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.779028] env[69358]: INFO networking_nsxv3.common.synchronization [None req-5205d779-0098-4fd6-9644-4a4cf0028497 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_rules [ 1045.779537] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_rules [ 1045.779852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.779967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.781549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.781549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.781678] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.845721] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1045.847661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.848582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.848749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.848996] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.849175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.849280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.849484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.849614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.849747] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.849979] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.904125] env[69358]: INFO networking_nsxv3.common.synchronization [None req-47fd005f-2fd2-4885-b25a-8e78dfc149fa tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_rules [ 1045.904731] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_rules [ 1045.905071] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.905230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.148656] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.259678] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.259901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.260018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.260327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.260460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.260582] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1046.328373] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.328582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.328773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.328888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.328975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.329153] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 already deleted. [ 1046.329219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.329325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.329482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.329605] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.355202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.355364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.355434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.355867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.356094] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.356094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.356251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.356330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.356446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.356579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.356735] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.356830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.356893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.357049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.357203] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.357298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.357359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.357557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.357642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.357725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.357821] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.361184] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.361308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.361308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.361496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.361574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.386625] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1046.652251] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.652251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.652251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.652251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.652251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.652251] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb is going to be updated. [ 1046.730820] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.731072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.731072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.731312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.731458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.764572] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: IN_PROGRESS for 2s [ 1046.856484] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.856484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.856484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.856690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.856724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.857071] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 already deleted. [ 1046.857071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.862736] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3493b731-517b-4900-a67f-0d87ba7896a4: rpc.has_security_group_logging(os_id): False [ 1046.881524] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.882757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.882949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.883260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.883459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.887121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.887121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.887121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.887121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.888336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.888575] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be created. [ 1046.965294] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.965466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.965722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.966047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.966336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.978189] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1047.850890] env[69358]: INFO networking_nsxv3.common.synchronization [req-0116910b-2331-4182-8557-0efa886f3fb2 req-03577c8b-6801-4e98-b73d-9fe482801dc0 tempest-MultipleCreateTestJSON-1931979633 tempest-MultipleCreateTestJSON-1931979633-project-member] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1047.855488] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1047.856871] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.856871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.857167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.857560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.858806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.858806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.858806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.858806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.858806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.858806] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.337072] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.337296] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.337435] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.337781] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.338318] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.338494] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.338685] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.339082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.339190] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.339413] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1048.339536] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.339649] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.339758] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.339872] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1048.339981] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.340139] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.358983] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.359171] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1048.359335] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.359531] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.360168] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e98136dd-b149-4c5c-b0e8-c9813e000fcc taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.360358] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e98136dd-b149-4c5c-b0e8-c9813e000fcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.360488] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e98136dd-b149-4c5c-b0e8-c9813e000fcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.360815] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e98136dd-b149-4c5c-b0e8-c9813e000fcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.360966] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e98136dd-b149-4c5c-b0e8-c9813e000fcc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.362105] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.398736] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1048.399009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.633294] env[69358]: INFO networking_nsxv3.common.synchronization [None req-84c32f4b-c131-4173-be5d-d8054c70f84c None None] Enqueued Resource ID: 093656f2-4011-4067-8064-b13552cb0670 with Priority: HIGHEST for action port [ 1048.633397] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093656f2-4011-4067-8064-b13552cb0670 with Priority: HIGHEST for action port [ 1048.633941] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-093656f2-4011-4067-8064-b13552cb0670 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.634064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-093656f2-4011-4067-8064-b13552cb0670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.634137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-093656f2-4011-4067-8064-b13552cb0670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.635287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-093656f2-4011-4067-8064-b13552cb0670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.635287] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('093656f2-4011-4067-8064-b13552cb0670',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.775895] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: SUCCESS [ 1048.776093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.776242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.776446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.776630] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.776747] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.776808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.776957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.777055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.777136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.777282] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.777370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.777424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.777588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.777721] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.777825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.777885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.778030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.778104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.778181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.778267] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.866364] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.866710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.866710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.867150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.867150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.867376] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e98136dd-b149-4c5c-b0e8-c9813e000fcc not found, creating... [ 1048.867584] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.867748] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.867871] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.868110] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.868297] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.868845] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.869031] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.869161] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.869379] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.869520] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.869674] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e98136dd-b149-4c5c-b0e8-c9813e000fcc is going to be created. [ 1048.870793] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.889966] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.890193] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.890312] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.890581] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.890811] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.891052] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e98136dd-b149-4c5c-b0e8-c9813e000fcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.992943] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1048.993024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.136988] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 093656f2-4011-4067-8064-b13552cb0670 [ 1049.137306] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.137465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.137626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.138014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.138180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.138347] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:093656f2-4011-4067-8064-b13552cb0670 already deleted. [ 1049.138494] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-093656f2-4011-4067-8064-b13552cb0670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.280846] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb: rpc.has_security_group_logging(os_id): False [ 1049.298988] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.299147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.299228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.299419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.299507] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.299729] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.299835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.299905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.300066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.300140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.300343] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.300436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.300499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.300630] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.300705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.300880] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.300969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.301043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.301211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.301318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.302218] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb is going to be created. [ 1049.306021] env[69358]: INFO networking_nsxv3.common.synchronization [None req-eaad7396-c8e1-4879-8fb0-5905e10d9404 tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1049.307150] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1049.307150] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.307150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.307150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.307331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.307331] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.356031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.356199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.356314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.358030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.358030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.367828] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: IN_PROGRESS for 2s [ 1049.376039] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.376039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.376039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.376039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.376039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.376039] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1049.405396] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.405396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.405396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.405396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.405396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.421314] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1049.432505] env[69358]: INFO networking_nsxv3.common.synchronization [None req-aa71f31f-8b27-4151-b79b-df28e47c138e tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1049.432505] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1049.434121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.434121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.672584] env[69358]: INFO networking_nsxv3.common.synchronization [req-0116910b-2331-4182-8557-0efa886f3fb2 req-04fabae1-40dd-4c13-beca-1911b9e68d3c service nova] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_rules [ 1049.672738] env[69358]: INFO networking_nsxv3.common.synchronization [req-0116910b-2331-4182-8557-0efa886f3fb2 req-04fabae1-40dd-4c13-beca-1911b9e68d3c service nova] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1049.672926] env[69358]: INFO networking_nsxv3.common.synchronization [req-0116910b-2331-4182-8557-0efa886f3fb2 req-04fabae1-40dd-4c13-beca-1911b9e68d3c service nova] Enqueued Resource ID: e98136dd-b149-4c5c-b0e8-c9813e000fcc with Priority: HIGHEST for action port [ 1049.673487] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_rules [ 1049.673630] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1049.673756] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98136dd-b149-4c5c-b0e8-c9813e000fcc with Priority: HIGHEST for action port [ 1049.675896] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.676019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.676103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.679662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.679806] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.680785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.681022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.681158] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e98136dd-b149-4c5c-b0e8-c9813e000fcc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.681275] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e98136dd-b149-4c5c-b0e8-c9813e000fcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.681361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e98136dd-b149-4c5c-b0e8-c9813e000fcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.681554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e98136dd-b149-4c5c-b0e8-c9813e000fcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.681669] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e98136dd-b149-4c5c-b0e8-c9813e000fcc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.826193] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.826193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.826193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.826400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.826495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.826631] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 already deleted. [ 1049.828476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.828476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.828476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.828476] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.184034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.184368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.184473] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e98136dd-b149-4c5c-b0e8-c9813e000fcc with status ACTIVE [ 1050.184679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.184830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.184900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.186294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.186341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.187341] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.187474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.190568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.190649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.190748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.191130] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.191130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.191265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.191322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.191405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.191491] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e98136dd-b149-4c5c-b0e8-c9813e000fcc is going to be updated. [ 1050.222851] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.223033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.223096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.223312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.223442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.223605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e98136dd-b149-4c5c-b0e8-c9813e000fcc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.264648] env[69358]: INFO networking_nsxv3.common.synchronization [req-322b1889-84ad-4ac7-be58-6680a51c9ed0 req-9f897392-e390-4f51-b688-74f2bf1a73ee tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1050.264648] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1050.264648] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.265165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.265165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.265240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.265463] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.265607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.265695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.265927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.266062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.266184] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.359021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.359021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.359021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.359021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.359021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.359021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 already deleted. [ 1050.359021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.707883] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.707883] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.707883] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.707883] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.707883] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.707883] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.707883] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.709077] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.710140] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.711262] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.711466] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.711607] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.711766] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.711914] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.712158] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.713114] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.733996] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.734192] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1050.734338] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.734515] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.734941] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4fd30f55-b31b-413c-986f-ae97468dfd86 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.735144] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4fd30f55-b31b-413c-986f-ae97468dfd86" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.735275] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4fd30f55-b31b-413c-986f-ae97468dfd86" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.735837] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4fd30f55-b31b-413c-986f-ae97468dfd86" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.735837] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fd30f55-b31b-413c-986f-ae97468dfd86',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.770266] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.770266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.770266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.770266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.770460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.770501] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.771612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.771612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.771612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.771612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.771612] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1050.776205] env[69358]: INFO networking_nsxv3.common.synchronization [None req-4394befe-292f-45d0-bde4-3de5ecdaffcc None None] Enqueued Resource ID: da0ce2f9-b117-429b-8064-ad7ca6e6a3fd with Priority: HIGHEST for action port [ 1050.778360] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da0ce2f9-b117-429b-8064-ad7ca6e6a3fd with Priority: HIGHEST for action port [ 1050.782042] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-da0ce2f9-b117-429b-8064-ad7ca6e6a3fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.782186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da0ce2f9-b117-429b-8064-ad7ca6e6a3fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.782256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da0ce2f9-b117-429b-8064-ad7ca6e6a3fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.782521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da0ce2f9-b117-429b-8064-ad7ca6e6a3fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.782604] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da0ce2f9-b117-429b-8064-ad7ca6e6a3fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.809178] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.809178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.809178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.809178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.809178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.817592] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1051.239052] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.239052] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.239052] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.239588] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.239588] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.239588] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 4fd30f55-b31b-413c-986f-ae97468dfd86 not found, creating... [ 1051.239828] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.240094] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.240269] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.240538] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.240725] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.241095] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.241305] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.241471] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.241721] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.241895] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.242080] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4fd30f55-b31b-413c-986f-ae97468dfd86 is going to be created. [ 1051.265807] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.266121] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.266227] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.266863] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.266863] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.266994] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4fd30f55-b31b-413c-986f-ae97468dfd86" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.285394] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da0ce2f9-b117-429b-8064-ad7ca6e6a3fd [ 1051.285677] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.285800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.285870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.286113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.286198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.286313] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da0ce2f9-b117-429b-8064-ad7ca6e6a3fd already deleted. [ 1051.286406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da0ce2f9-b117-429b-8064-ad7ca6e6a3fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.394335] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: SUCCESS [ 1051.394592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.394768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.394981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.395084] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.454817] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1051.455147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.455147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.455312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.455586] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.455714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.455837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.455995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.456091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.456191] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.899222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.901734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.901734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.901734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.901734] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.901734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.901734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.901734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.901734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.901734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.901734] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.958312] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.224562] env[69358]: INFO networking_nsxv3.common.synchronization [req-c2e6ed81-6eb0-4303-941d-996022a02e5f req-978c6933-29e5-47c3-8a0f-a53dcea6a29d tempest-ImagesTestJSON-1108879237 tempest-ImagesTestJSON-1108879237-project-member] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 1052.225137] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGHEST for action security_group_members [ 1052.225444] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.225567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.225646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.225863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.226202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.226391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.226484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.226667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.227191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.227356] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.342441] env[69358]: INFO networking_nsxv3.common.synchronization [req-322b1889-84ad-4ac7-be58-6680a51c9ed0 req-696fb31f-b1c8-4d9a-a122-ac09405aab4b service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 1052.342690] env[69358]: INFO networking_nsxv3.common.synchronization [req-322b1889-84ad-4ac7-be58-6680a51c9ed0 req-696fb31f-b1c8-4d9a-a122-ac09405aab4b service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1052.342761] env[69358]: INFO networking_nsxv3.common.synchronization [req-322b1889-84ad-4ac7-be58-6680a51c9ed0 req-696fb31f-b1c8-4d9a-a122-ac09405aab4b service nova] Enqueued Resource ID: 4fd30f55-b31b-413c-986f-ae97468dfd86 with Priority: HIGHEST for action port [ 1052.343255] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 1052.343389] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1052.343487] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fd30f55-b31b-413c-986f-ae97468dfd86 with Priority: HIGHEST for action port [ 1052.343757] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.344873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.345060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.345221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.345302] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.346153] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.346254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.346458] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fd30f55-b31b-413c-986f-ae97468dfd86 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.346563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fd30f55-b31b-413c-986f-ae97468dfd86" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.346644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fd30f55-b31b-413c-986f-ae97468dfd86" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.346793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fd30f55-b31b-413c-986f-ae97468dfd86" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.346868] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fd30f55-b31b-413c-986f-ae97468dfd86',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.403099] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.403340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.403340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.403509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.403665] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.403756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.404053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.404053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.404053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.404231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.406053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.406053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.406053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.406053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.406053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.406053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.406053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.406053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.406053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.406053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.406053] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.467101] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.730460] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.730626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.730699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.730919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.731015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.731209] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.731334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.731411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.731565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.731650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.731745] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be updated. [ 1052.762874] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.763065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.763150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.763385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.763527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.774792] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: IN_PROGRESS for 2s [ 1052.826887] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1052.827082] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 1052.827200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.827371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.827596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.827811] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.827928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.827991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.828162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.828236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.828334] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.848542] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.848763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.849209] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fd30f55-b31b-413c-986f-ae97468dfd86 with status ACTIVE [ 1052.849474] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.849621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.849704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.849965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.850123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.850320] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.850535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.850535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.850680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.850764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.850983] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.851103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.851199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.851350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.851423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.851521] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fd30f55-b31b-413c-986f-ae97468dfd86 is going to be updated. [ 1052.892234] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.892387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.892458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.892773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.893038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.893232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fd30f55-b31b-413c-986f-ae97468dfd86" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.907840] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb: rpc.has_security_group_logging(os_id): False [ 1052.928947] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.929138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.929202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.929401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.929546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.929705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.929817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.929986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.930061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.930143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.930345] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.930440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.930500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.930643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.930712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.930887] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.930979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.931469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.931667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.931759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.931852] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb is going to be updated. [ 1052.970808] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.970977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.971039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.971274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.971366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.971470] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1053.027296] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.027448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.027549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.027958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.028466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.032204] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.032344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.033553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.033553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.033553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.061112] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1053.078259] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: IN_PROGRESS for 2s [ 1053.331565] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.843193] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.346081] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.346271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.346340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.346527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.346656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.346773] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1054.376722] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.376996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.376996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.377222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.377388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.388963] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1054.786933] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45a41dd-b21d-4639-af89-ce7883a3d987 in Status: SUCCESS [ 1054.787145] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 deletion is rescheduled due to dependency. [ 1054.787278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.071137] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1055.071137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.071486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.071486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.071636] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.071913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.071913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.071980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.072045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.072135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.072227] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.094757] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: SUCCESS [ 1055.094988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.574970] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.575164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.575258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.575481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.575717] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.575837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.575902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.576065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.576156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.576245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.576396] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.576488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.576549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.576695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.576839] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.576955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.577029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.577174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.577252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.577354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.577621] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.081308] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3493b731-517b-4900-a67f-0d87ba7896a4: rpc.has_security_group_logging(os_id): False [ 1056.103069] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.103335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.103335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.103577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.103816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.104059] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.104190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.104258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.104434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.104709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.104938] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.105123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.105198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.105349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.105429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.105620] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.105849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.105958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.106138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.106234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.106328] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1056.167434] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.167586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.167668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.167930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.168093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.187462] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1056.401171] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1056.401332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.401509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.401751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.401973] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.402127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.402197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.402348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.402428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.402520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.402612] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.908029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.908029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.908029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.908029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.908029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.908930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.910158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.910158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.910158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.910158] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.149269] env[69358]: INFO networking_nsxv3.common.synchronization [req-e11781bf-7f0a-4a0d-a088-4560020397c9 req-46fb75df-da66-46d0-b7ae-d4677606c1ae tempest-ServerRescueTestJSON-24232825 tempest-ServerRescueTestJSON-24232825-project-member] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 1057.150131] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGHEST for action security_group_members [ 1057.150456] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.150620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.150718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.150978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.151184] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.151316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.151401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.151591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.151697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.151820] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.412037] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d904f37a-b3f7-4aef-9721-265081cb343b: rpc.has_security_group_logging(os_id): False [ 1057.432055] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.432235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.432309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.432508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.432639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.432865] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.432968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.433042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.433218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.433296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.433484] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.433578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.433640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.433773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.433879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.434216] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.434343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.434406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.434548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.434624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.434709] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1057.495780] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.496042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.496126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.496352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.496846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.508644] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1057.654743] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.654743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.654743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.654743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.654976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.654976] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.655173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.655173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.655281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.655361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.655491] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab is going to be updated. [ 1057.707120] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.707343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.707422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.707623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.707809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.718088] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: IN_PROGRESS for 2s [ 1058.199608] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1058.199997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.480028] env[69358]: INFO networking_nsxv3.common.synchronization [None req-5e63a239-a803-41fa-998d-ed6d8c9e37df None None] Enqueued Resource ID: 00144a6e-4280-4ecb-b159-e65fbd8ddd89 with Priority: HIGHEST for action port [ 1059.480028] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00144a6e-4280-4ecb-b159-e65fbd8ddd89 with Priority: HIGHEST for action port [ 1059.480028] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-00144a6e-4280-4ecb-b159-e65fbd8ddd89 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.480028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00144a6e-4280-4ecb-b159-e65fbd8ddd89" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.480028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00144a6e-4280-4ecb-b159-e65fbd8ddd89" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.480028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00144a6e-4280-4ecb-b159-e65fbd8ddd89" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.480028] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00144a6e-4280-4ecb-b159-e65fbd8ddd89',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.520676] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1059.520941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.564734] env[69358]: INFO networking_nsxv3.common.synchronization [req-baba9e3c-17c2-4dff-84ef-9bba6a271bd0 req-3cee7949-705e-4226-8b70-e2c12d74bac2 tempest-ServerActionsTestOtherB-1009679498 tempest-ServerActionsTestOtherB-1009679498-project-member] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1059.565315] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1059.565689] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.565861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.565943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.566201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.566376] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.566525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.566525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.567552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.567552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.567552] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.729674] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72792bb3-b78f-4b14-80d7-1253aec704ab in Status: SUCCESS [ 1059.730295] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab deletion is rescheduled due to dependency. [ 1059.730295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.983450] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00144a6e-4280-4ecb-b159-e65fbd8ddd89 [ 1059.983813] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.983972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.984057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.984713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.984713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.984713] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00144a6e-4280-4ecb-b159-e65fbd8ddd89 already deleted. [ 1059.984713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00144a6e-4280-4ecb-b159-e65fbd8ddd89" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.074650] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.074650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.074650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.074650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.074650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.074962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.074962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.075112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.075153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.075879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.075879] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1060.104067] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.104336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.104461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.104693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.104836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.120598] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1060.164368] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-285 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.164567] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.164695] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.164989] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.165320] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.165486] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.165825] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.165825] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.165977] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.166208] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.166324] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.166436] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.166547] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.166657] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.166766] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.166899] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.190299] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.190692] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.190996] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.191331] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.191835] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-83e6f551-5a35-4b1d-b825-0c07c8d18877 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.193022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-83e6f551-5a35-4b1d-b825-0c07c8d18877" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.193022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-83e6f551-5a35-4b1d-b825-0c07c8d18877" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.193022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-83e6f551-5a35-4b1d-b825-0c07c8d18877" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.193022] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83e6f551-5a35-4b1d-b825-0c07c8d18877',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.700277] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.701264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.701264] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.701527] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.701608] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.701789] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 83e6f551-5a35-4b1d-b825-0c07c8d18877 not found, creating... [ 1060.702388] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.703091] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.703091] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.703091] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.703091] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.703548] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.703639] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.703760] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.703985] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.704145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.704311] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 83e6f551-5a35-4b1d-b825-0c07c8d18877 is going to be created. [ 1060.736678] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.736923] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.737120] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.737426] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.737661] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.737943] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-83e6f551-5a35-4b1d-b825-0c07c8d18877" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.097273] env[69358]: INFO networking_nsxv3.common.synchronization [req-1d96105f-3ad1-44ec-8908-6e950aba63be req-f7dc81d4-30d9-4852-93bb-91680676ee91 tempest-MultipleCreateTestJSON-1931979633 tempest-MultipleCreateTestJSON-1931979633-project-member] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1061.097863] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1061.098445] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.098445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.098445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.098659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.098849] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.098981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.099060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.099238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.099330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.099458] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.312445] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf6e42b9-6967-4135-9350-038b0b29edcd req-2d9eb4ac-b2b7-4a14-96c4-31fb967fb5e6 tempest-MultipleCreateTestJSON-1931979633 tempest-MultipleCreateTestJSON-1931979633-project-member] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1061.312934] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1061.313255] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.313549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.536898] env[69358]: INFO networking_nsxv3.common.synchronization [req-baba9e3c-17c2-4dff-84ef-9bba6a271bd0 req-0400bf4b-68bc-4d4b-bb04-4075e7a4cfa5 service nova] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 1061.537086] env[69358]: INFO networking_nsxv3.common.synchronization [req-baba9e3c-17c2-4dff-84ef-9bba6a271bd0 req-0400bf4b-68bc-4d4b-bb04-4075e7a4cfa5 service nova] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1061.537259] env[69358]: INFO networking_nsxv3.common.synchronization [req-baba9e3c-17c2-4dff-84ef-9bba6a271bd0 req-0400bf4b-68bc-4d4b-bb04-4075e7a4cfa5 service nova] Enqueued Resource ID: 83e6f551-5a35-4b1d-b825-0c07c8d18877 with Priority: HIGHEST for action port [ 1061.537659] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 1061.537659] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1061.537793] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83e6f551-5a35-4b1d-b825-0c07c8d18877 with Priority: HIGHEST for action port [ 1061.538335] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.538514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.538514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.538685] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.538771] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.540423] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.540423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.540423] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-83e6f551-5a35-4b1d-b825-0c07c8d18877 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.540423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83e6f551-5a35-4b1d-b825-0c07c8d18877" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.540423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83e6f551-5a35-4b1d-b825-0c07c8d18877" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.540423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83e6f551-5a35-4b1d-b825-0c07c8d18877" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.540423] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83e6f551-5a35-4b1d-b825-0c07c8d18877',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.601248] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.777618] env[69358]: INFO networking_nsxv3.common.synchronization [None req-dd793236-00b5-49f2-a830-603313d724df None None] Enqueued Resource ID: dd589b6d-ac11-4f04-a0b6-f4dcb1153eed with Priority: HIGHEST for action port [ 1061.777854] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd589b6d-ac11-4f04-a0b6-f4dcb1153eed with Priority: HIGHEST for action port [ 1061.778477] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd589b6d-ac11-4f04-a0b6-f4dcb1153eed taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.778609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd589b6d-ac11-4f04-a0b6-f4dcb1153eed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.778675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd589b6d-ac11-4f04-a0b6-f4dcb1153eed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.778972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd589b6d-ac11-4f04-a0b6-f4dcb1153eed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.782218] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd589b6d-ac11-4f04-a0b6-f4dcb1153eed',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.042449] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.042599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.042748] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83e6f551-5a35-4b1d-b825-0c07c8d18877 with status ACTIVE [ 1062.042916] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.043035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.043095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.043307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.043395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.043568] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.044389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.044389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.044389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.044389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.044389] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.044389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.044389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.044697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.044697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.044697] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83e6f551-5a35-4b1d-b825-0c07c8d18877 is going to be updated. [ 1062.064805] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.065019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.065118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.065392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.065569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.065859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83e6f551-5a35-4b1d-b825-0c07c8d18877" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.103900] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.129542] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 4s [ 1062.283529] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd589b6d-ac11-4f04-a0b6-f4dcb1153eed [ 1062.283762] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.283892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.283959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.286043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.286043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.286043] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd589b6d-ac11-4f04-a0b6-f4dcb1153eed already deleted. [ 1062.286043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd589b6d-ac11-4f04-a0b6-f4dcb1153eed" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.606605] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.606719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.606790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.607020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.607150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.607201] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1062.637607] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.637748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.637993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.638272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.638414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.649182] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1063.840472] env[69358]: INFO networking_nsxv3.common.synchronization [req-3abcb4be-be2d-4ffc-a483-fd823fd7d4dd req-9df65ab7-2df6-4a92-b3d3-17744f6f7660 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_members [ 1063.841047] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_members [ 1063.841047] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-193bc791-0b82-49f5-a278-c6f34ab0eaf3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.841331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.841331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.841483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.843091] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.843091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.843091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.843091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.843091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.843091] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.141196] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1064.141450] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b deletion is rescheduled due to dependency. [ 1064.141829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.142030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.142277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.142468] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.142589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.142657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.142828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.142912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.143023] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.291982] env[69358]: INFO networking_nsxv3.common.synchronization [req-50526c2d-1aa9-4071-b892-81c36788a71f req-1584a5a3-07d5-4d77-8e06-e6ccb4a24ef3 tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1064.292499] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1064.295016] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.295016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.295016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.295016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.295016] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.295016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.295016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.295016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.295016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.295016] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.329250] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.329483] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.329610] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.329913] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.330207] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.330386] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.330511] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.330729] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.330874] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.331853] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.332859] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.332859] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.332859] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.332859] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.332859] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.332859] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.349025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.349025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.349025] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 already deleted. [ 1064.349025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.351170] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.351343] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.351485] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.351650] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.353271] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-f799a7e7-fc27-4152-9233-739516fe2607 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.353271] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-f799a7e7-fc27-4152-9233-739516fe2607" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.353271] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-f799a7e7-fc27-4152-9233-739516fe2607" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.353497] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-f799a7e7-fc27-4152-9233-739516fe2607" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.353556] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f799a7e7-fc27-4152-9233-739516fe2607',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.649422] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.668095] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1064.668585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.668585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.668747] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.668924] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.669022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.669109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.669248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.669327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.669432] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.796457] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.857165] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.857165] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.857165] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.857504] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.857504] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.857568] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port f799a7e7-fc27-4152-9233-739516fe2607 not found, creating... [ 1064.857788] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.858017] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.858200] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.858440] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.858611] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.858879] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.859078] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.859215] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.859431] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.859571] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.859719] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: f799a7e7-fc27-4152-9233-739516fe2607 is going to be created. [ 1064.885691] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.885691] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.885691] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.885691] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.885691] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.885691] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-f799a7e7-fc27-4152-9233-739516fe2607" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.158704] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.171837] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.172091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.172091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.172272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.172361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.172547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.172642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.172726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.172834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.172909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.172993] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1065.199668] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.199668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.199668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.199668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.199942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.209743] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1065.298774] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.604954] env[69358]: INFO networking_nsxv3.common.synchronization [req-3abcb4be-be2d-4ffc-a483-fd823fd7d4dd req-5df836c3-899d-4911-bd7e-7714adc48c65 service nova] Enqueued Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_rules [ 1065.604954] env[69358]: INFO networking_nsxv3.common.synchronization [req-3abcb4be-be2d-4ffc-a483-fd823fd7d4dd req-5df836c3-899d-4911-bd7e-7714adc48c65 service nova] Enqueued Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_members [ 1065.604954] env[69358]: INFO networking_nsxv3.common.synchronization [req-3abcb4be-be2d-4ffc-a483-fd823fd7d4dd req-5df836c3-899d-4911-bd7e-7714adc48c65 service nova] Enqueued Resource ID: f799a7e7-fc27-4152-9233-739516fe2607 with Priority: HIGHEST for action port [ 1065.604954] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_rules [ 1065.604954] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_members [ 1065.604954] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f799a7e7-fc27-4152-9233-739516fe2607 with Priority: HIGHEST for action port [ 1065.604954] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.604954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.604954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.604954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.604954] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.605983] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-193bc791-0b82-49f5-a278-c6f34ab0eaf3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.605983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.606181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.606181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.606537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.606616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.606616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.606750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.606837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.606924] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.608141] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-f799a7e7-fc27-4152-9233-739516fe2607 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.608289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f799a7e7-fc27-4152-9233-739516fe2607" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.608336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f799a7e7-fc27-4152-9233-739516fe2607" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.608472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f799a7e7-fc27-4152-9233-739516fe2607" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.608550] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f799a7e7-fc27-4152-9233-739516fe2607',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.660748] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.660953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.660995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.661287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.661404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.661470] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1065.690278] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.690463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.690463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.690663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.690803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.698719] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1065.801544] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.801807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.801807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.803038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.803038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.803038] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1065.831209] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.831383] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.831446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.832206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.832206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.840353] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1066.108939] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.110013] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f799a7e7-fc27-4152-9233-739516fe2607 with status ACTIVE [ 1066.110281] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.110420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.110465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.110662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.110744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.110920] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.111117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.111117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.111262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.111333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.111547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.111661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.111722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.111859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.111965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.112282] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f799a7e7-fc27-4152-9233-739516fe2607 is going to be updated. [ 1066.114612] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-193bc791-0b82-49f5-a278-c6f34ab0eaf3 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.114707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.134200] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.134349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.134419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.134628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.134758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.135172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f799a7e7-fc27-4152-9233-739516fe2607" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.310953] env[69358]: INFO networking_nsxv3.common.synchronization [req-ce1c1542-0651-4a16-b166-00a0321310f1 req-55d467da-8e8a-4ece-ab1f-b5df0806535e tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1066.311537] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1066.311843] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.311964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.312053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.312367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.312538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.312644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.312709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.312865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.312950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.313060] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.612379] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.612617] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.612747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.613132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.613407] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.613592] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.613714] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.613964] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.614165] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.614417] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.614539] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.614650] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.614758] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.614889] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.615006] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.615161] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.616642] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.650970] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.650970] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1066.650970] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.650970] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.650970] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-54af5c81-d29d-476b-99f6-c1502d28c86b taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.650970] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-54af5c81-d29d-476b-99f6-c1502d28c86b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.650970] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-54af5c81-d29d-476b-99f6-c1502d28c86b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.650970] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-54af5c81-d29d-476b-99f6-c1502d28c86b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.650970] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54af5c81-d29d-476b-99f6-c1502d28c86b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.815012] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.815218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.815299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.815447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.815537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.815793] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.816115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.816115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.816257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.816322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.816373] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 already deleted. [ 1066.816423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.118635] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.118942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.118942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.119067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.119176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.119278] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 is going to be created. [ 1067.143056] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.143056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.143056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.143056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.143056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.154745] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 in Status: UNINITIALIZED for 2s [ 1067.155342] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.155579] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.155735] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.156095] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.156260] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.156447] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 54af5c81-d29d-476b-99f6-c1502d28c86b not found, creating... [ 1067.156727] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.156913] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.157067] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.157460] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.157460] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.157714] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.157906] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.158121] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.158303] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.158464] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.158612] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 54af5c81-d29d-476b-99f6-c1502d28c86b is going to be created. [ 1067.180844] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.181082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.181221] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.181598] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.181898] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.182153] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-54af5c81-d29d-476b-99f6-c1502d28c86b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.221593] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1067.221838] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 deletion is rescheduled due to dependency. [ 1067.221999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.709209] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1067.709522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.709689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.709975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.710308] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.710455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.710455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.710647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.710752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.710864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.710976] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.850019] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1067.850257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.214870] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.243707] env[69358]: INFO networking_nsxv3.common.synchronization [req-ce1c1542-0651-4a16-b166-00a0321310f1 req-c0c2dc66-a3e6-4513-94f5-ff4cee7e4f9d service nova] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1068.243707] env[69358]: INFO networking_nsxv3.common.synchronization [req-ce1c1542-0651-4a16-b166-00a0321310f1 req-c0c2dc66-a3e6-4513-94f5-ff4cee7e4f9d service nova] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1068.243707] env[69358]: INFO networking_nsxv3.common.synchronization [req-ce1c1542-0651-4a16-b166-00a0321310f1 req-c0c2dc66-a3e6-4513-94f5-ff4cee7e4f9d service nova] Enqueued Resource ID: 54af5c81-d29d-476b-99f6-c1502d28c86b with Priority: HIGHEST for action port [ 1068.243707] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1068.243707] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1068.243707] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54af5c81-d29d-476b-99f6-c1502d28c86b with Priority: HIGHEST for action port [ 1068.244313] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.244313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.244539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.244600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.244661] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.245910] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.246043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.246110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.246279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.246430] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.246529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.246594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.246710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.246789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.246876] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.249487] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-54af5c81-d29d-476b-99f6-c1502d28c86b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.249647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54af5c81-d29d-476b-99f6-c1502d28c86b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.249647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54af5c81-d29d-476b-99f6-c1502d28c86b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.249813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54af5c81-d29d-476b-99f6-c1502d28c86b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.249889] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54af5c81-d29d-476b-99f6-c1502d28c86b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.716935] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0f3175f-70d6-4954-936f-524f7ca25a4b: rpc.has_security_group_logging(os_id): False [ 1068.735442] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.735663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.735715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.736114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.736231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.736490] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.736595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.736661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.736823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.736900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.737046] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1068.751651] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.752628] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.752760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.752935] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54af5c81-d29d-476b-99f6-c1502d28c86b with status ACTIVE [ 1068.753129] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.753240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.753320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.753508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.753586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.753964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.753964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.753964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.754129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.754164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.754330] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.754421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.754480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.754615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.754693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.754795] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54af5c81-d29d-476b-99f6-c1502d28c86b is going to be updated. [ 1068.777361] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.777531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.777637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.777875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.778090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.778308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54af5c81-d29d-476b-99f6-c1502d28c86b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.797702] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.797864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.797864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.798145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.798282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.815801] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1069.164798] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 in Status: SUCCESS [ 1069.164798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.165015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.165580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.165580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.165580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.165855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.165855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.165934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.165980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.166093] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.227045] env[69358]: INFO networking_nsxv3.common.synchronization [req-2ba2404d-71f6-406c-ba45-b2683f78c487 req-c1d659f8-00f0-4867-aa6e-7b6203de8b25 tempest-ServerRescueNegativeTestJSON-1118501628 tempest-ServerRescueNegativeTestJSON-1118501628-project-member] Enqueued Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_members [ 1069.227667] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGHEST for action security_group_members [ 1069.228082] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.228244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.228327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.228600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.228775] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.228875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.228937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.229257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.229257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.229384] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.257222] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.668422] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.735619] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.736099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.736210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.736471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.736568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.736771] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.736881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.736944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.737150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.737241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.737335] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 is going to be updated. [ 1069.759902] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.760095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.760189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.760443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.760567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.760748] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be created. [ 1069.764250] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.764432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.765010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.765278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.765465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.773911] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 in Status: IN_PROGRESS for 2s [ 1069.794599] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.794756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.794827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.795062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.795223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.815400] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: UNINITIALIZED for 2s [ 1070.172397] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 193bc791-0b82-49f5-a278-c6f34ab0eaf3: rpc.has_security_group_logging(os_id): False [ 1070.204840] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.204840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.204840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.204840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.204840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.204840] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.204840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.204840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.204840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.204840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.204840] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 is going to be created. [ 1070.286111] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.286111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.286111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.286111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.286662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.300072] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 in Status: IN_PROGRESS for 2s [ 1070.829741] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1070.829978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.785155] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 in Status: SUCCESS [ 1071.785521] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 deletion is rescheduled due to dependency. [ 1071.785521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.904145] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1071.904462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.904656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.904910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.907072] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.907237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.907278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.907442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.907524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.907612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.907702] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.312059] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 in Status: SUCCESS [ 1072.312059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.411087] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.521186] env[69358]: INFO networking_nsxv3.common.synchronization [req-59d796c1-110f-4483-81dd-fb03a7c76657 req-0920593e-c6b8-421b-8de8-5a5fe393eba3 tempest-VolumesAdminNegativeTest-1170171242 tempest-VolumesAdminNegativeTest-1170171242-project-member] Enqueued Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGHEST for action security_group_members [ 1072.521898] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGHEST for action security_group_members [ 1072.522159] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0705eac-ee26-4e23-89df-ec51465c3981 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.522280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.522350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.522662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.522874] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.522991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.523103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.523279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.523367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.523463] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.897052] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-694 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.901236] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-694" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.901236] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-694" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.901236] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-694" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.901236] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.901236] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.901236] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.901236] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.901236] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.901236] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.901236] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.901236] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.901236] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.901236] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.901236] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.901236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.915915] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70627b51-3375-41aa-82f3-78ff340110c2: rpc.has_security_group_logging(os_id): False [ 1072.923037] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.923223] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1072.923398] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.923542] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-694" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.923860] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.924048] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.924175] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.924603] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.924823] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb6a72d-3dd3-448e-8b23-f02dad9cea5e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.933438] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.933438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.933438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.933438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.933694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.933739] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.933827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.933889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.934057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.934136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.934223] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be created. [ 1072.994160] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.994324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.994393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.994583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.994758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.005894] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1073.027918] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.028147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.028221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.028435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.028524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.028786] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.028889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.028954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.029148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.029230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.029318] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0705eac-ee26-4e23-89df-ec51465c3981 already deleted. [ 1073.029395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.431188] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.431276] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.431402] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.431723] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.431882] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.432111] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 6bb6a72d-3dd3-448e-8b23-f02dad9cea5e not found, creating... [ 1073.432463] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.432658] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.432800] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.433115] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.433293] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.433587] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.433743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.433862] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.434086] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.434228] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.434367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 6bb6a72d-3dd3-448e-8b23-f02dad9cea5e is going to be created. [ 1073.454512] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.454512] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.454512] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.454869] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.454996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.455253] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.136682] env[69358]: INFO networking_nsxv3.common.synchronization [req-59d796c1-110f-4483-81dd-fb03a7c76657 req-f7fd3033-79f9-4b1a-a2ad-34d7e1166162 service nova] Enqueued Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGHEST for action security_group_rules [ 1074.136977] env[69358]: INFO networking_nsxv3.common.synchronization [req-59d796c1-110f-4483-81dd-fb03a7c76657 req-f7fd3033-79f9-4b1a-a2ad-34d7e1166162 service nova] Enqueued Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGHEST for action security_group_members [ 1074.137078] env[69358]: INFO networking_nsxv3.common.synchronization [req-59d796c1-110f-4483-81dd-fb03a7c76657 req-f7fd3033-79f9-4b1a-a2ad-34d7e1166162 service nova] Enqueued Resource ID: 6bb6a72d-3dd3-448e-8b23-f02dad9cea5e with Priority: HIGHEST for action port [ 1074.137630] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGHEST for action security_group_rules [ 1074.137789] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGHEST for action security_group_members [ 1074.137942] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb6a72d-3dd3-448e-8b23-f02dad9cea5e with Priority: HIGHEST for action port [ 1074.139540] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0705eac-ee26-4e23-89df-ec51465c3981 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.139670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.139736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.139993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.140167] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.140951] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0705eac-ee26-4e23-89df-ec51465c3981 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.141091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.141157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.141355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.144455] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.144455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.144455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.144455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.144455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.144455] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.144455] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.144455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.144455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.144455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.144455] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb6a72d-3dd3-448e-8b23-f02dad9cea5e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.645488] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0705eac-ee26-4e23-89df-ec51465c3981 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.645715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.645801] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bb6a72d-3dd3-448e-8b23-f02dad9cea5e with status ACTIVE [ 1074.646428] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.646428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.646428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.646428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.646428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.646845] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.646845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.646845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.646845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.647113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.647113] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.647244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.647244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.647385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.647452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.647518] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bb6a72d-3dd3-448e-8b23-f02dad9cea5e is going to be updated. [ 1074.648733] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.670298] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.670458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.670532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.670742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.671349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.671349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb6a72d-3dd3-448e-8b23-f02dad9cea5e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.987076] env[69358]: INFO networking_nsxv3.common.synchronization [req-77ddcca4-d8fb-4985-ad2b-369af31c6edc req-c61b6905-ae39-4cdd-8f8d-8a1134ad8359 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1074.987770] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1074.987962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.988735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.988863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.989156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.989335] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.989453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.989518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.989680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.989783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.989876] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.019296] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1075.019559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.151269] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.466019] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.466019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-792" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.466019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-792" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.466019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-792" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.466019] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.466769] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.467088] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.467471] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.470546] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.470546] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.470546] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.470546] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.470546] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.470546] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.470546] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.470546] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.488064] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.488064] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.488064] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.488064] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-792" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.488064] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.488064] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.488064] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.488064] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.488680] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('793cd9d5-886f-4128-a82d-c7c5b6cbce6a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.495736] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.495736] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.495736] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 already deleted. [ 1075.495736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.661411] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.661411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.661411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.661411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.661411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.661411] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0705eac-ee26-4e23-89df-ec51465c3981 is going to be created. [ 1075.688208] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.688208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.688208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.688208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.688208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.695720] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0705eac-ee26-4e23-89df-ec51465c3981 in Status: UNINITIALIZED for 2s [ 1075.995141] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.995141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.995141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.995141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.995141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.995141] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 793cd9d5-886f-4128-a82d-c7c5b6cbce6a not found, creating... [ 1075.995141] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.995141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.995141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.995141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.995141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.995916] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.996430] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.996735] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.997153] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.998107] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.998107] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a is going to be created. [ 1076.030544] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.032637] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.032637] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.032637] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.032637] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.032637] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.819686] env[69358]: INFO networking_nsxv3.common.synchronization [req-77ddcca4-d8fb-4985-ad2b-369af31c6edc req-282d4a47-8da2-4b71-b78a-b9b90e91911a service nova] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1076.819686] env[69358]: INFO networking_nsxv3.common.synchronization [req-77ddcca4-d8fb-4985-ad2b-369af31c6edc req-282d4a47-8da2-4b71-b78a-b9b90e91911a service nova] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1076.819686] env[69358]: INFO networking_nsxv3.common.synchronization [req-77ddcca4-d8fb-4985-ad2b-369af31c6edc req-282d4a47-8da2-4b71-b78a-b9b90e91911a service nova] Enqueued Resource ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with Priority: HIGHEST for action port [ 1076.819686] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1076.819686] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1076.819686] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with Priority: HIGHEST for action port [ 1076.820182] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.820182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.820182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.821031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.821031] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.821798] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.821919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.822137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.822223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.822997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.822997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.822997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.822997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.823376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.823376] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.824157] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.824308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.824381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.824529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.824718] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('793cd9d5-886f-4128-a82d-c7c5b6cbce6a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.177279] env[69358]: INFO networking_nsxv3.common.synchronization [req-ec4b6866-2a1d-4ab2-9b75-7dcc54ca4e34 req-497df4f3-b521-4a8b-ac2e-54f1221873eb tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1077.177803] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1077.178853] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.178853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.178853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.179085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.179153] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.179265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.179333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.179486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.179567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.179659] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.208066] env[69358]: INFO networking_nsxv3.common.synchronization [req-ec4b6866-2a1d-4ab2-9b75-7dcc54ca4e34 req-497df4f3-b521-4a8b-ac2e-54f1221873eb tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 1077.208294] env[69358]: INFO networking_nsxv3.common.synchronization [req-ec4b6866-2a1d-4ab2-9b75-7dcc54ca4e34 req-497df4f3-b521-4a8b-ac2e-54f1221873eb tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1077.208440] env[69358]: INFO networking_nsxv3.common.synchronization [req-ec4b6866-2a1d-4ab2-9b75-7dcc54ca4e34 req-497df4f3-b521-4a8b-ac2e-54f1221873eb tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: d11ced64-d501-4729-8060-f95b71050ea8 with Priority: HIGHEST for action port [ 1077.208917] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 1077.209076] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1077.209176] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ced64-d501-4729-8060-f95b71050ea8 with Priority: HIGHEST for action port [ 1077.209447] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.209568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.209636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.209837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.209921] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.218018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.218206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.218505] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d11ced64-d501-4729-8060-f95b71050ea8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.219064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.219064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.221088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.221232] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11ced64-d501-4729-8060-f95b71050ea8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.318456] env[69358]: INFO networking_nsxv3.common.synchronization [req-4f20dee0-1513-4c20-ad04-7b2a93ad5287 req-55ecf0a9-4120-4a0a-b9f1-5310b038d223 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1077.319253] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1077.319574] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.320294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.320294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.320294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.324474] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.325741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.325832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.326066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.326159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.326268] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.327731] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with status ACTIVE [ 1077.327731] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.327731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.327961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.327961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.328105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.328513] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.328513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.328513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.328876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.328876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.328876] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.329078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.329078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.335065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.335065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.335065] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a is going to be updated. [ 1077.339753] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.340780] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.340921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.360436] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.360685] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.360800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.361634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.361634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.361634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.650215] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.650386] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.650490] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.650848] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.651193] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.651391] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.651488] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.651722] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.651874] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.652101] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.652215] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.652325] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.652435] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.652548] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.652741] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.652777] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.671286] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.671458] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.671601] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.671825] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.672170] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-baaacc07-1ac8-465c-b6c0-1d01174943c4 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.672359] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-baaacc07-1ac8-465c-b6c0-1d01174943c4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.672483] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-baaacc07-1ac8-465c-b6c0-1d01174943c4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.672821] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-baaacc07-1ac8-465c-b6c0-1d01174943c4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.672964] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baaacc07-1ac8-465c-b6c0-1d01174943c4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.682086] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.716757] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0705eac-ee26-4e23-89df-ec51465c3981 in Status: SUCCESS [ 1077.717009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.717191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.717445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.717651] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.717790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.717859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.718046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.718142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.718240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.718351] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.723677] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.723677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.729203] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d11ced64-d501-4729-8060-f95b71050ea8 with status ACTIVE [ 1077.729452] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.729594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.729675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.729909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.730016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.730241] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.730417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.730417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.730675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.730725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.730903] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.731035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.731103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.731257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.731342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.731438] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d11ced64-d501-4729-8060-f95b71050ea8 is going to be updated. [ 1077.756028] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.756367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.756458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.756678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.756814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.756976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.845020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.845020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.845020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.845020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.845020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.845020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.845020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.845020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.845020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.845020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.845020] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1077.845020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.892389] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.892389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.892389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.892389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.892389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.904056] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1078.178132] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.178132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.178132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.178132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.178132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.178132] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port baaacc07-1ac8-465c-b6c0-1d01174943c4 not found, creating... [ 1078.178132] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.178132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.178132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.178132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.178132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.179357] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.179930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.180870] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.180870] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.181260] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.181554] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: baaacc07-1ac8-465c-b6c0-1d01174943c4 is going to be created. [ 1078.183964] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.204401] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.206837] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.206837] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.206837] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.206837] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.206837] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-baaacc07-1ac8-465c-b6c0-1d01174943c4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.223022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0705eac-ee26-4e23-89df-ec51465c3981 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.223022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.223022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0705eac-ee26-4e23-89df-ec51465c3981 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.223022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.223022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.223698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.223698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.223698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.223698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.223698] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.350028] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.350028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.350028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.350028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.350028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.350028] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be created. [ 1078.377375] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.377872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.378236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.380201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.380201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.390084] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: UNINITIALIZED for 2s [ 1078.686525] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.689983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.689983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.689983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.689983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.689983] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf is going to be updated. [ 1078.717151] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.717151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.717151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.717151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.717151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.724317] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: IN_PROGRESS for 2s [ 1078.728903] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0705eac-ee26-4e23-89df-ec51465c3981: rpc.has_security_group_logging(os_id): False [ 1078.747279] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.747279] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.747279] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.747279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.748839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.748839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.748839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.749636] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.749636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.750290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.752225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.752225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.752225] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0705eac-ee26-4e23-89df-ec51465c3981 is going to be created. [ 1078.806897] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.806897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.806897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.807162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.807334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.819036] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0705eac-ee26-4e23-89df-ec51465c3981 in Status: IN_PROGRESS for 2s [ 1079.294358] env[69358]: INFO networking_nsxv3.common.synchronization [req-4f20dee0-1513-4c20-ad04-7b2a93ad5287 req-b464075b-0a03-4af7-82a4-4b24c32741f2 service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 1079.294600] env[69358]: INFO networking_nsxv3.common.synchronization [req-4f20dee0-1513-4c20-ad04-7b2a93ad5287 req-b464075b-0a03-4af7-82a4-4b24c32741f2 service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1079.295253] env[69358]: INFO networking_nsxv3.common.synchronization [req-4f20dee0-1513-4c20-ad04-7b2a93ad5287 req-b464075b-0a03-4af7-82a4-4b24c32741f2 service nova] Enqueued Resource ID: baaacc07-1ac8-465c-b6c0-1d01174943c4 with Priority: HIGHEST for action port [ 1079.296095] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 1079.296249] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1079.296347] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baaacc07-1ac8-465c-b6c0-1d01174943c4 with Priority: HIGHEST for action port [ 1079.296641] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.296767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.296834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.297126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.297222] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.298531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.298629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.298893] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-baaacc07-1ac8-465c-b6c0-1d01174943c4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.298977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baaacc07-1ac8-465c-b6c0-1d01174943c4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.299048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baaacc07-1ac8-465c-b6c0-1d01174943c4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.299289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baaacc07-1ac8-465c-b6c0-1d01174943c4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.299357] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baaacc07-1ac8-465c-b6c0-1d01174943c4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.801640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.801640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.801640] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port baaacc07-1ac8-465c-b6c0-1d01174943c4 with status ACTIVE [ 1079.801640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.801640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.801640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.801965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.801965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.802122] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.802178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.802238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.802518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.802518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.802621] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.802730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.802775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.802926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.803063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.803163] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: baaacc07-1ac8-465c-b6c0-1d01174943c4 is going to be updated. [ 1079.839295] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.839503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.839599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.840350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.840517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.840698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baaacc07-1ac8-465c-b6c0-1d01174943c4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.922729] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1079.922944] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c deletion is rescheduled due to dependency. [ 1079.923097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.923289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.923514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.923694] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.923807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.923871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.924050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.924169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.924240] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.401027] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1080.401328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.401363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.402162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.402162] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.402162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.402162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.402162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.402365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.402365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.402365] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.431038] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.738057] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: SUCCESS [ 1080.738420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.738681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.739033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.739262] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.739389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.739455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.739637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.739724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.739841] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.839245] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0705eac-ee26-4e23-89df-ec51465c3981 in Status: SUCCESS [ 1080.839461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.906538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.906688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.906763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.906987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.907165] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.907263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.907326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.907471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.907556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.907642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.907787] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.907967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.908037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.908177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.908315] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.908404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.908463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.908598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.908672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.908753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.908843] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.934861] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.242783] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.411380] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4335c702-c854-428a-bca2-25e63a950287: rpc.has_security_group_logging(os_id): False [ 1081.435555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.435753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.435821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.436047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.436144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.436377] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.436484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.436552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.436692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.436784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.436972] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.437076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.437155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.437335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.437420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.437634] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.437794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.437857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.438015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.438295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.438415] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be created. [ 1081.440329] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.440511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.440621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.440843] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.440960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.441121] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1081.500733] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.500898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.500988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.501193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.501335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.510294] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1081.536802] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1081.536998] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1081.540226] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.540410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.540410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.540721] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.540815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.553311] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1081.745366] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.046027] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf92a374-984d-4bae-a281-c4a836936068 req-353633bb-a942-4431-81cc-7c5f6dc961df tempest-MultipleCreateTestJSON-1931979633 tempest-MultipleCreateTestJSON-1931979633-project-member] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1082.046900] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1082.046900] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.046900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.047488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.047488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.047488] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.047488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.047766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.047766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.047877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.047983] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.247710] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.247893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.247991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.248228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.248300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.248408] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf is going to be updated. [ 1082.281313] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.282260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.282260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.282260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.282260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.292267] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: IN_PROGRESS for 2s [ 1082.425562] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.425852] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.426243] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.426243] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.426470] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.426922] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.426922] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.427026] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.427145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.427367] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.427495] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.427595] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.428309] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.428309] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.428309] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.428309] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.446739] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.446946] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1082.447354] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.447577] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.447989] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a18f492a-d638-4885-81ac-ed278ae57ca3 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.448284] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a18f492a-d638-4885-81ac-ed278ae57ca3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.448473] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a18f492a-d638-4885-81ac-ed278ae57ca3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.448895] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a18f492a-d638-4885-81ac-ed278ae57ca3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.449075] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a18f492a-d638-4885-81ac-ed278ae57ca3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.550739] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.550980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.551087] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.551316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.551417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.551662] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.551766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.551832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.551988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.552119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.552211] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1082.579452] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.579602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.579737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.579915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.580143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.589654] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1082.792597] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c0570c7-8e58-4439-a868-19b19f63209a req-55cbbc31-590e-449b-8527-3111346102a8 tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1082.793185] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1082.793600] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.793716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.809894] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c0570c7-8e58-4439-a868-19b19f63209a req-55cbbc31-590e-449b-8527-3111346102a8 tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 1082.810082] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c0570c7-8e58-4439-a868-19b19f63209a req-55cbbc31-590e-449b-8527-3111346102a8 tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1082.810261] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c0570c7-8e58-4439-a868-19b19f63209a req-55cbbc31-590e-449b-8527-3111346102a8 tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: d11ced64-d501-4729-8060-f95b71050ea8 with Priority: HIGHEST for action port [ 1082.810756] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_rules [ 1082.811175] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1082.811346] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ced64-d501-4729-8060-f95b71050ea8 with Priority: HIGHEST for action port [ 1082.811585] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.811686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.811879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.811968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.812158] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d11ced64-d501-4729-8060-f95b71050ea8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.812288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.812318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.812512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.812593] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11ced64-d501-4729-8060-f95b71050ea8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.953686] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.953931] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.954181] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.954494] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.954656] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.954851] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a18f492a-d638-4885-81ac-ed278ae57ca3 not found, creating... [ 1082.955163] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.955332] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.955511] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.955689] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.955914] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.956249] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.956413] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.956532] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.956754] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.956917] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.957085] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a18f492a-d638-4885-81ac-ed278ae57ca3 is going to be created. [ 1082.988035] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.988331] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.988456] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.989265] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.989541] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.989915] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a18f492a-d638-4885-81ac-ed278ae57ca3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.314926] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d11ced64-d501-4729-8060-f95b71050ea8 with status ACTIVE [ 1083.315184] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.315324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.315406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.315595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.315683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.315879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.315976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.316048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.316624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.316624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.316624] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.316624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.316624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.316845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.316845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.316899] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d11ced64-d501-4729-8060-f95b71050ea8 is going to be updated. [ 1083.341540] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.341676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.341779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.341957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.342104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.342257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d11ced64-d501-4729-8060-f95b71050ea8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.520968] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1083.521298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.521440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.521706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.521875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.521991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.522070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.522229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.522312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.522399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.522492] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.566821] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1083.566821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.025987] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.025987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.025987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.025987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.025987] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.025987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.025987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.025987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.025987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.025987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.025987] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.026565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.026565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.026565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.026565] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.026565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.026565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.026809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.026809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.026883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.026938] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.127538] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf92a374-984d-4bae-a281-c4a836936068 req-1916e581-5b32-4eba-bbb7-271454110436 service nova] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_rules [ 1084.127712] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf92a374-984d-4bae-a281-c4a836936068 req-1916e581-5b32-4eba-bbb7-271454110436 service nova] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1084.127883] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf92a374-984d-4bae-a281-c4a836936068 req-1916e581-5b32-4eba-bbb7-271454110436 service nova] Enqueued Resource ID: a18f492a-d638-4885-81ac-ed278ae57ca3 with Priority: HIGHEST for action port [ 1084.128134] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_rules [ 1084.128260] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1084.128355] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f492a-d638-4885-81ac-ed278ae57ca3 with Priority: HIGHEST for action port [ 1084.128922] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.129187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.129187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.129344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.129425] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.130283] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.130380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.130572] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a18f492a-d638-4885-81ac-ed278ae57ca3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.130688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a18f492a-d638-4885-81ac-ed278ae57ca3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.130764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a18f492a-d638-4885-81ac-ed278ae57ca3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.130937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a18f492a-d638-4885-81ac-ed278ae57ca3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.131018] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a18f492a-d638-4885-81ac-ed278ae57ca3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.232342] env[69358]: INFO networking_nsxv3.common.synchronization [None req-e1f159e2-922b-462a-b38c-ed04ed0bf0b3 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1084.232941] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1084.233561] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.233703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.233773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.234040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.234232] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.234340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.234403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.234832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.234832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.234832] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.307101] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: SUCCESS [ 1084.307269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.307444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.307744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.308023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.308155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.308236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.308414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.308487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.308572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.308674] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.309695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.309872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.310133] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.310255] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.310323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.310506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.310563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.311428] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.504193] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf92a374-984d-4bae-a281-c4a836936068 req-b064c955-53e9-4d95-a00d-f9c448145192 tempest-MultipleCreateTestJSON-1931979633 tempest-MultipleCreateTestJSON-1931979633-project-member] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1084.504741] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1084.505061] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.505189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.533228] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51af08cc-9a30-4dff-8fb1-ae75e324301c: rpc.has_security_group_logging(os_id): False [ 1084.555074] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.555074] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.555074] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.555074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.555836] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.555949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.556024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.556181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.556257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.556367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1084.599227] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1084.599227] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 deletion is rescheduled due to dependency. [ 1084.599227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.599412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.599808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.599808] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.599914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.599988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.600254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.600308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.600420] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.620297] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.620505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.620569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.620773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.620922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.633086] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.633254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.635195] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1084.635405] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a18f492a-d638-4885-81ac-ed278ae57ca3 with status ACTIVE [ 1084.635606] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.635760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.635835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.636071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.636168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.636401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.636534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.636638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.636853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.636999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.637209] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.637321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.637388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.637550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.637628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.637729] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a18f492a-d638-4885-81ac-ed278ae57ca3 is going to be updated. [ 1084.658738] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.658820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.658861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.659069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.659210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.659371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a18f492a-d638-4885-81ac-ed278ae57ca3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.737513] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.813086] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.814063] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.850381] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.852150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.852150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.852150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.852150] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.852150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.852150] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.852450] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.852631] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.854148] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.854314] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.854449] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.854576] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.854731] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.855063] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.855229] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.878938] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.879174] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1084.879522] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.879522] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-112" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.879854] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.880196] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.880420] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.881034] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.883701] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('536afcbe-2ecc-4ca1-82c3-2ea8f5db953e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.103395] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.239950] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.316255] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9000b38-d75e-47e3-86fe-4cd98fcbfecf: rpc.has_security_group_logging(os_id): False [ 1085.317698] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.334978] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.335222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.335327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.335562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.335697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.336022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.336163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.336282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.336435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.336544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.336659] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf is going to be updated. [ 1085.386306] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.386548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.386682] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.386982] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.387152] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.387318] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 536afcbe-2ecc-4ca1-82c3-2ea8f5db953e not found, creating... [ 1085.387591] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.387787] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.387981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.388293] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.388440] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.388731] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.388896] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.389161] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.389399] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.389541] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.389690] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 536afcbe-2ecc-4ca1-82c3-2ea8f5db953e is going to be created. [ 1085.406923] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.407109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.407174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.407426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.407612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.409717] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.409929] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.410110] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.410322] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.410533] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.410742] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.428033] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: IN_PROGRESS for 2s [ 1085.605737] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.743183] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.743360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.743437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.744220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.744220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.744220] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1085.776851] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.777107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.777179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.777423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.777577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.789216] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1085.819859] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.820030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.820115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.820347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.820441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.820543] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf is going to be updated. [ 1085.866820] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.866820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.866820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.866820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.867072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.876558] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: IN_PROGRESS for 2s [ 1086.110012] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.110332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.110332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.110536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.110631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.110737] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1086.144559] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf92a374-984d-4bae-a281-c4a836936068 req-4f0a78cd-7735-4461-b809-0e3f54181f14 service nova] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_rules [ 1086.144739] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf92a374-984d-4bae-a281-c4a836936068 req-4f0a78cd-7735-4461-b809-0e3f54181f14 service nova] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1086.145057] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf92a374-984d-4bae-a281-c4a836936068 req-4f0a78cd-7735-4461-b809-0e3f54181f14 service nova] Enqueued Resource ID: 536afcbe-2ecc-4ca1-82c3-2ea8f5db953e with Priority: HIGHEST for action port [ 1086.145504] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_rules [ 1086.145647] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1086.145787] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 536afcbe-2ecc-4ca1-82c3-2ea8f5db953e with Priority: HIGHEST for action port [ 1086.146119] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.146235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.146633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.146743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.147071] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.147196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.147254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.147454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.147563] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('536afcbe-2ecc-4ca1-82c3-2ea8f5db953e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.149332] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.149332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.149474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.149580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.149721] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.161907] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1086.626983] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.627401] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.627401] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.627835] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.628557] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.628827] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.629306] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.629683] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.629943] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.630296] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.630777] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.631247] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.631334] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.632261] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.632261] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.632261] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.652550] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 536afcbe-2ecc-4ca1-82c3-2ea8f5db953e with status ACTIVE [ 1086.652822] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.652950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.653039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.653263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.654164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.654164] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.654164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.654164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.654164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.654164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.654164] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.654164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.654567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.654567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.654567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.654567] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 536afcbe-2ecc-4ca1-82c3-2ea8f5db953e is going to be updated. [ 1086.656487] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.656659] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1086.657241] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.657781] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.658098] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a3fdecce-e214-4d19-b786-709ea7102e0b taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.658215] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a3fdecce-e214-4d19-b786-709ea7102e0b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.658320] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a3fdecce-e214-4d19-b786-709ea7102e0b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.658798] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a3fdecce-e214-4d19-b786-709ea7102e0b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.658981] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3fdecce-e214-4d19-b786-709ea7102e0b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.661664] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1086.661994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.695457] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.695608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.695689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.695886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.696034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.696198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-536afcbe-2ecc-4ca1-82c3-2ea8f5db953e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.035519] env[69358]: INFO networking_nsxv3.common.synchronization [req-6b1a7678-78f0-4078-9ed2-7d641541bfd6 req-25f3990e-670e-4365-8049-f0f1f98db04b tempest-AttachInterfacesUnderV243Test-904674725 tempest-AttachInterfacesUnderV243Test-904674725-project-member] Enqueued Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1087.036131] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf with Priority: HIGHEST for action security_group_members [ 1087.036440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.036542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.163209] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.163446] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.163616] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.163947] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.164152] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.164346] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a3fdecce-e214-4d19-b786-709ea7102e0b not found, creating... [ 1087.164663] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.164870] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.165019] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.165297] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.165572] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.165854] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.166069] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.166222] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.166503] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.166688] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.166856] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a3fdecce-e214-4d19-b786-709ea7102e0b is going to be created. [ 1087.219071] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.219310] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.219453] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.219733] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.219976] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.220247] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a3fdecce-e214-4d19-b786-709ea7102e0b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.441767] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: SUCCESS [ 1087.441997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.442188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.442405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.442491] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.800525] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1087.800525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.842402] env[69358]: INFO networking_nsxv3.common.synchronization [req-673ad90e-f477-4f20-a961-38a669e4c177 req-8d02d4e0-d1d0-4c8d-9322-583076f1c3a8 tempest-VolumesAdminNegativeTest-1170171242 tempest-VolumesAdminNegativeTest-1170171242-project-member] Enqueued Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGHEST for action security_group_members [ 1087.842402] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGHEST for action security_group_members [ 1087.842402] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0705eac-ee26-4e23-89df-ec51465c3981 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.842402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.842402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.842402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.842402] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.842402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.842999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.843293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.844149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.844149] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.886662] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf in Status: SUCCESS [ 1087.886662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.886842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.886951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.887188] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.887312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.890374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.890374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.890374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.890374] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.965172] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.965330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.965429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.965828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.965945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.966655] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf is going to be deleted. [ 1088.029579] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.029786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.029786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.030027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.030125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.030248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.178685] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1088.178922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.179115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.179335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.179527] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.179649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.179711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.179932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.179932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.180048] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.297252] env[69358]: INFO networking_nsxv3.common.synchronization [req-0a846fd0-1713-4de8-bfc6-2b4a1487220f req-4e0fb705-7579-4e77-9919-03e1a28f5b8b tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1088.297880] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1088.298208] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.298484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.298484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.299366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.299821] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.299821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.299981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.300141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.300141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.302303] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.332157] env[69358]: INFO networking_nsxv3.common.synchronization [req-7719fa5d-0d74-4548-addc-499d57ede4d4 req-7de23bd7-c649-47da-8b06-832bcdeeedc5 service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 1088.332157] env[69358]: INFO networking_nsxv3.common.synchronization [req-7719fa5d-0d74-4548-addc-499d57ede4d4 req-7de23bd7-c649-47da-8b06-832bcdeeedc5 service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1088.332157] env[69358]: INFO networking_nsxv3.common.synchronization [req-7719fa5d-0d74-4548-addc-499d57ede4d4 req-7de23bd7-c649-47da-8b06-832bcdeeedc5 service nova] Enqueued Resource ID: a3fdecce-e214-4d19-b786-709ea7102e0b with Priority: HIGHEST for action port [ 1088.333187] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 1088.333340] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1088.333448] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fdecce-e214-4d19-b786-709ea7102e0b with Priority: HIGHEST for action port [ 1088.333763] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.333913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.333981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.334196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.334278] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.336219] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.336361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.336430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.336616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.336770] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.336862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.336920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.337066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.337148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.337237] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.339096] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3fdecce-e214-4d19-b786-709ea7102e0b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.339096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3fdecce-e214-4d19-b786-709ea7102e0b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.339096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3fdecce-e214-4d19-b786-709ea7102e0b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.339096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3fdecce-e214-4d19-b786-709ea7102e0b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.339218] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3fdecce-e214-4d19-b786-709ea7102e0b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.347100] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.347258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.347326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.347556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.347636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.348577] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.348577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.348577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.348577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.348577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.348577] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0705eac-ee26-4e23-89df-ec51465c3981 is going to be updated. [ 1088.379042] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.379195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.379265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.379489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.379635] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.392433] env[69358]: INFO networking_nsxv3.common.synchronization [req-eaeb56a3-5107-4958-a308-128ef1e65d02 req-eabf448b-8b97-49a6-a9ed-0dd6a8ee8f92 tempest-ServerRescueNegativeTestJSON-1118501628 tempest-ServerRescueNegativeTestJSON-1118501628-project-member] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 1088.393781] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0705eac-ee26-4e23-89df-ec51465c3981 in Status: IN_PROGRESS for 2s [ 1088.394432] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.394583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.394683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.394945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.395223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.395771] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.395927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.396099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.396298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.396452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.396598] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf is going to be deleted. [ 1088.398276] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 1088.399283] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.399463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.399551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.399771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.399928] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.400121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.402590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.403540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.403540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.403540] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.442327] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.442539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.442617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.442867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.442968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.443095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.443245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.443404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.443563] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.443661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.443722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.443867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.443950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.444058] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9000b38-d75e-47e3-86fe-4cd98fcbfecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.683100] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.805830] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.841704] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.841859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.842069] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.842973] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3fdecce-e214-4d19-b786-709ea7102e0b with status ACTIVE [ 1088.843204] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.843337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.843411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.843645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.843759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.843962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.844075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.844140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.844304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.844379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.846249] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.846546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.846546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.847067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.847203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.847326] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3fdecce-e214-4d19-b786-709ea7102e0b is going to be updated. [ 1088.871029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.871029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.871029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.871029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.871319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.871319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3fdecce-e214-4d19-b786-709ea7102e0b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.908784] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.946578] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.946766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.946893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.947235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.947418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.947789] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.947898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.947985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.948195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.948282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.948381] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9000b38-d75e-47e3-86fe-4cd98fcbfecf already deleted. [ 1088.948469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9000b38-d75e-47e3-86fe-4cd98fcbfecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.189093] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.309661] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.350860] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.410147] env[69358]: INFO networking_nsxv3.common.synchronization [req-5463f341-57c9-44b2-a8e4-1a046f700a2b req-87d0550c-f98f-4e1f-baf5-e1d15e5c0918 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1089.410454] env[69358]: INFO networking_nsxv3.common.synchronization [req-5463f341-57c9-44b2-a8e4-1a046f700a2b req-87d0550c-f98f-4e1f-baf5-e1d15e5c0918 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1089.410892] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1089.410996] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1089.411325] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.412507] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.412632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.412760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.412954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.413128] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.413231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.413292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.413441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.413525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.413613] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.414332] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.414445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.414512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.414661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.414799] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.414893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.414954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.415110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.415180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.415261] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.434382] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.434578] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.434706] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.435013] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.435298] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.435463] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.435586] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.435810] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.435978] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.436190] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.436312] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.436432] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.436546] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.436851] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.437021] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.437358] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.458407] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.458407] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.458407] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.458407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.458407] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-b2dc759a-ce08-4dd7-acca-f62998a362ec taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.458407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-b2dc759a-ce08-4dd7-acca-f62998a362ec" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.458407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-b2dc759a-ce08-4dd7-acca-f62998a362ec" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.458407] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-b2dc759a-ce08-4dd7-acca-f62998a362ec" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.458407] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dc759a-ce08-4dd7-acca-f62998a362ec',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.462241] env[69358]: INFO networking_nsxv3.common.synchronization [req-5463f341-57c9-44b2-a8e4-1a046f700a2b req-87d0550c-f98f-4e1f-baf5-e1d15e5c0918 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1089.462241] env[69358]: INFO networking_nsxv3.common.synchronization [req-5463f341-57c9-44b2-a8e4-1a046f700a2b req-87d0550c-f98f-4e1f-baf5-e1d15e5c0918 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1089.462241] env[69358]: INFO networking_nsxv3.common.synchronization [req-5463f341-57c9-44b2-a8e4-1a046f700a2b req-87d0550c-f98f-4e1f-baf5-e1d15e5c0918 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_rules [ 1089.462241] env[69358]: INFO networking_nsxv3.common.synchronization [req-5463f341-57c9-44b2-a8e4-1a046f700a2b req-87d0550c-f98f-4e1f-baf5-e1d15e5c0918 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1089.462241] env[69358]: INFO networking_nsxv3.common.synchronization [req-5463f341-57c9-44b2-a8e4-1a046f700a2b req-87d0550c-f98f-4e1f-baf5-e1d15e5c0918 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with Priority: HIGHEST for action port [ 1089.462241] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1089.462883] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_rules [ 1089.463150] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with Priority: HIGHEST for action port [ 1089.463150] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1089.463282] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1089.463455] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.463563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.466114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.466114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.466114] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.466114] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.468212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.469105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.469105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.469105] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.470164] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.470295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.470357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.470525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.470598] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('793cd9d5-886f-4128-a82d-c7c5b6cbce6a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.471360] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.471500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.471637] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.471724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.693567] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.693567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.693567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.693567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.693567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.693567] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1089.722130] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.722349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.722349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.722567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.722718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.731601] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1089.812771] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.813167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.813167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.813273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.813442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.813498] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1089.853566] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.853794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.853853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.854068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.854177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.858151] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1089.861348] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.861515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.861589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.861800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.861953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.873428] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1089.888875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.889074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.889133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.889351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.889490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.898786] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1089.915728] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.915943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.916073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.916339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.917122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.917122] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be updated. [ 1089.918147] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.920576] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.961075] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.961226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.961296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.961534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.961680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.965301] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.965301] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.965449] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.966207] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.966207] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.966207] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port b2dc759a-ce08-4dd7-acca-f62998a362ec not found, creating... [ 1089.966323] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.966372] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.966682] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.966746] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.966864] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.969475] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.969475] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.969475] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.969475] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.969475] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.969475] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: b2dc759a-ce08-4dd7-acca-f62998a362ec is going to be created. [ 1089.971396] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.971396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.972957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.972957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.976640] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with status ACTIVE [ 1089.976640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.976640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.976640] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.976640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.976640] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a is going to be updated. [ 1089.977235] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: IN_PROGRESS for 2s [ 1089.996580] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.996804] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.997115] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.997249] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.997773] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.997773] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-b2dc759a-ce08-4dd7-acca-f62998a362ec" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.999373] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.999490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.999556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.999723] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.999844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.999984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.077558] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGHEST for action security_group_members [ 1090.077763] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1090.077907] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1090.078400] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGHEST for action security_group_members [ 1090.078754] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1090.078907] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1090.079219] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c45f18-eee4-4639-b07a-413cc1624dbc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.079334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.079404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.079844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.080027] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.080129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.080180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.080368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.080449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.080544] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.081762] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.081923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.082060] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.082137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.404056] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0705eac-ee26-4e23-89df-ec51465c3981 in Status: SUCCESS [ 1090.404263] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0705eac-ee26-4e23-89df-ec51465c3981 deletion is rescheduled due to dependency. [ 1090.404362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.418490] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1090.418732] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1090.418884] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGHEST for action security_group_rules [ 1090.419039] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGHEST for action security_group_members [ 1090.419178] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_rules [ 1090.419387] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1090.419581] env[69358]: INFO networking_nsxv3.common.synchronization [req-296054c5-29cc-498f-a54f-1bf87a427e29 req-50a2759d-25dc-4770-87bf-06664c74126e tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with Priority: HIGHEST for action port [ 1090.420475] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1090.420650] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGHEST for action security_group_rules [ 1090.420873] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1090.420959] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with Priority: HIGHEST for action port [ 1090.421030] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_rules [ 1090.421151] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1090.421268] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGHEST for action security_group_members [ 1090.421522] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.422538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.422674] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.422905] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75c45f18-eee4-4639-b07a-413cc1624dbc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.423027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.423239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.423358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.423440] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.424280] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.424427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.424664] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.424775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.424840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.425032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.425102] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('793cd9d5-886f-4128-a82d-c7c5b6cbce6a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.426026] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.426136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.426374] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.426487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.426725] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c45f18-eee4-4639-b07a-413cc1624dbc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.430212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.431375] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.583648] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.624645] env[69358]: INFO networking_nsxv3.common.synchronization [None req-41e69781-9437-406d-859a-a72fe12c7d66 None None] Enqueued Resource ID: 79e44339-909c-44d9-8d90-704bd514a164 with Priority: HIGHEST for action port [ 1090.625500] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e44339-909c-44d9-8d90-704bd514a164 with Priority: HIGHEST for action port [ 1090.626142] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-79e44339-909c-44d9-8d90-704bd514a164 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.626754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79e44339-909c-44d9-8d90-704bd514a164" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.626963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79e44339-909c-44d9-8d90-704bd514a164" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.627463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79e44339-909c-44d9-8d90-704bd514a164" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.627734] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79e44339-909c-44d9-8d90-704bd514a164',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.806194] env[69358]: INFO networking_nsxv3.common.synchronization [req-0a846fd0-1713-4de8-bfc6-2b4a1487220f req-6e17ccd7-e095-4f32-8256-ddffea242502 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 1090.806276] env[69358]: INFO networking_nsxv3.common.synchronization [req-0a846fd0-1713-4de8-bfc6-2b4a1487220f req-6e17ccd7-e095-4f32-8256-ddffea242502 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1090.806526] env[69358]: INFO networking_nsxv3.common.synchronization [req-0a846fd0-1713-4de8-bfc6-2b4a1487220f req-6e17ccd7-e095-4f32-8256-ddffea242502 service nova] Enqueued Resource ID: b2dc759a-ce08-4dd7-acca-f62998a362ec with Priority: HIGHEST for action port [ 1090.807211] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 1090.807413] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1090.808365] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2dc759a-ce08-4dd7-acca-f62998a362ec with Priority: HIGHEST for action port [ 1090.808365] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.808365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.808365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.808873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.809039] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.810284] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.810428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.811220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2dc759a-ce08-4dd7-acca-f62998a362ec taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.811395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2dc759a-ce08-4dd7-acca-f62998a362ec" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.811488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2dc759a-ce08-4dd7-acca-f62998a362ec" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.812048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2dc759a-ce08-4dd7-acca-f62998a362ec" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.812185] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dc759a-ce08-4dd7-acca-f62998a362ec',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.931377] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 793cd9d5-886f-4128-a82d-c7c5b6cbce6a with status ACTIVE [ 1090.931662] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.931819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.931893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.932938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.932938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.932938] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.932938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.932938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.932938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.933315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.933315] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.933504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.933621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.933820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.933962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.938024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 793cd9d5-886f-4128-a82d-c7c5b6cbce6a is going to be updated. [ 1090.938024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.938024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.938024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.938024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.938024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.938024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be created. [ 1090.939580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c45f18-eee4-4639-b07a-413cc1624dbc taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.939743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.940236] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.940406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.940510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.940723] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.940821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.940948] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1090.969299] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.969454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.969527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.969748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.969890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.970086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-793cd9d5-886f-4128-a82d-c7c5b6cbce6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.970950] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.971418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.971553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.971852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.972057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.977887] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.978413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.978547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.978784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.978970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.981802] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: UNINITIALIZED for 2s [ 1090.988119] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1091.086752] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.130765] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79e44339-909c-44d9-8d90-704bd514a164 [ 1091.131136] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.131338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.131410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.131686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.131777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.131922] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79e44339-909c-44d9-8d90-704bd514a164 already deleted. [ 1091.132146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79e44339-909c-44d9-8d90-704bd514a164" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.318346] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.318346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.318346] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2dc759a-ce08-4dd7-acca-f62998a362ec with status ACTIVE [ 1091.318346] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.318346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.318346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.318662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.318662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.318712] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.318771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.318828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.318983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.319069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.319248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.319334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.319391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.319527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.319596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.319679] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2dc759a-ce08-4dd7-acca-f62998a362ec is going to be updated. [ 1091.341612] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.341778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.341778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.342037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.342130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.342319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2dc759a-ce08-4dd7-acca-f62998a362ec" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.589800] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.589800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.590051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.590132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.590230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.590329] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c45f18-eee4-4639-b07a-413cc1624dbc is going to be created. [ 1091.620387] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.620558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.620629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.620830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.620984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.630556] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c45f18-eee4-4639-b07a-413cc1624dbc in Status: UNINITIALIZED for 2s [ 1091.743230] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1091.743446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.743609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.743858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.744022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.744133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.744201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.744346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.744429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.744514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.744609] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.745520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.745686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.745843] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.745946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.746027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.746175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.746251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.746336] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.892766] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1091.892766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.892766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.892766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.892766] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.892766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.892766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.894096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.894256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.894423] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.912486] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1091.912771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.912847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.913069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.913258] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.913369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.913432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.914180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.914180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.914180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.914180] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.988858] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: SUCCESS [ 1091.988858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.249257] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.249257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.249257] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.401401] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.418748] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.421013] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.421013] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.421013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.421329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.421421] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.421546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.421644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.421867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.421993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.422149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.422302] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.529690] env[69358]: INFO networking_nsxv3.common.synchronization [None req-59f2d522-dc1c-4245-82b4-5a9177bb080c None None] Enqueued Resource ID: 61d8480c-f7f1-4bed-a243-6dfbe741d12c with Priority: HIGHEST for action port [ 1092.529894] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d8480c-f7f1-4bed-a243-6dfbe741d12c with Priority: HIGHEST for action port [ 1092.530578] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-61d8480c-f7f1-4bed-a243-6dfbe741d12c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.530712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61d8480c-f7f1-4bed-a243-6dfbe741d12c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.530781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61d8480c-f7f1-4bed-a243-6dfbe741d12c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.531065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61d8480c-f7f1-4bed-a243-6dfbe741d12c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.531149] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61d8480c-f7f1-4bed-a243-6dfbe741d12c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.750986] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.904379] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.924936] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51af08cc-9a30-4dff-8fb1-ae75e324301c: rpc.has_security_group_logging(os_id): False [ 1092.948431] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.948713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.948713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.949024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.949179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.949466] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.949616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.949731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.949946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.950085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.950371] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.950530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.950620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.950818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.950946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.951244] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.951388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.951504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.951699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.951825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.951960] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1092.990377] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: SUCCESS [ 1092.990688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.990874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.991034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.991221] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.991344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.991407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.991543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.991622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.991720] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.000625] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1093.000832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.001276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.001510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.002152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.002152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.002152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.002152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.002152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.002363] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.021276] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.021427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.021427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.021623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.021830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.033439] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61d8480c-f7f1-4bed-a243-6dfbe741d12c [ 1093.036704] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.036704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.036704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.036704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.036704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.036704] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61d8480c-f7f1-4bed-a243-6dfbe741d12c already deleted. [ 1093.036704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61d8480c-f7f1-4bed-a243-6dfbe741d12c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.040029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1093.258199] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.260403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.260403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.260403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.260403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.260403] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1093.290182] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.290694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.290694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.290694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.290820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.300096] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1093.406447] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.406623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.406682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.406905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.406992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.407105] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1093.437985] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.437985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.437985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.437985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.437985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.445360] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1093.494442] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.506540] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.643101] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c45f18-eee4-4639-b07a-413cc1624dbc in Status: SUCCESS [ 1093.643389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.643517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.643730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.643918] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.644076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.644156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.644302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.644379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.644474] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.998070] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.008330] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.147455] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.503392] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.504944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.504944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.504944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.504944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.504944] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be updated. [ 1094.513211] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.513211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.513211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.513211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.513211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.513211] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1094.542683] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.542885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.544780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.544780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.544780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.546925] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.547266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.547357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.547769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.548065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.559928] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1094.560735] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: IN_PROGRESS for 2s [ 1094.658031] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.056376] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1095.056714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.157621] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.157844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.157919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.158300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.159030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.159030] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c45f18-eee4-4639-b07a-413cc1624dbc is going to be updated. [ 1095.189935] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.190144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.190222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.190438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.190588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.200364] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c45f18-eee4-4639-b07a-413cc1624dbc in Status: IN_PROGRESS for 2s [ 1095.311366] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1095.311366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.311366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.311366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.311366] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.311366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.311366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.311366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.311366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.311366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.311755] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.311755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.311755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.311873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.311975] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.312077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.312138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.312276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.312353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.312435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.313127] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.455606] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1095.455606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.458328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.458570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.458787] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.458913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.458980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.459171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.459323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.459323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.459417] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.816708] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3493b731-517b-4900-a67f-0d87ba7896a4: rpc.has_security_group_logging(os_id): False [ 1095.834186] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.834395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.835353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.835718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.836018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.836287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.836531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.836641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.836902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.837043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.837418] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.838191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.838282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.838473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.838560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.838961] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.839848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.839936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.840139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.840215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.840318] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1095.914806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.915035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.915035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.915221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.915369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.931587] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1095.962399] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.963058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.963058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.963257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.963637] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.963637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.963813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.965132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.965132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.965132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.965132] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.965132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.965132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.965132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.965414] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.965414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.965498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.966457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.966457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.966457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.966457] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.469155] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 1096.493352] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.493352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.493352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.493352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.493352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.493679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.493679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.493777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.493878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.493951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.494172] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.494264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.494327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.494477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.494535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.494731] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.494811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.494898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.495467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.495467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.495467] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1096.570136] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1096.570352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.570508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.570787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.570975] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.571116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.571183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.571334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.571411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.571536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.571600] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.572999] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: SUCCESS [ 1096.573180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.575238] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.575238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.575238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.575238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.575238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.575637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.575818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.575955] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.576077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.576147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.576300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.576856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.576856] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.577853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.578039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.578680] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.578680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.578680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.578680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.578680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.578941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.578941] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.580349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.580349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.580508] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.580669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.580717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.580913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.581020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.581146] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.591847] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1097.082601] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.082767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.082986] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.083926] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.085039] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.210674] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c45f18-eee4-4639-b07a-413cc1624dbc in Status: SUCCESS [ 1097.210920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.211110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.211324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.211520] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.211637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.211705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.211855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.211936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.212030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.212123] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.470256] env[69358]: INFO networking_nsxv3.common.synchronization [req-370d45ba-768b-4c55-b4b4-f3b1619430af req-ffc9c60b-6c6e-4b10-b331-edcebfcfdaf6 tempest-MultipleCreateTestJSON-1931979633 tempest-MultipleCreateTestJSON-1931979633-project-member] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1097.470798] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1097.471467] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.471598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.471690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.471900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.472882] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.473871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.473871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.473871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.473871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.473871] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.587915] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.589165] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.594125] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5b54a11-30a4-4b59-9e2e-3429b26a65f9: rpc.has_security_group_logging(os_id): False [ 1097.615118] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.615386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.615478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.615968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.616124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.616604] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.616726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.616931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.617399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.617910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.618096] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be created. [ 1097.680871] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.681086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.681086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.681299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.681469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.694893] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: IN_PROGRESS for 2s [ 1097.718439] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.905682] env[69358]: INFO networking_nsxv3.common.synchronization [req-5563f4a9-faff-45d4-bbf2-8c5024088155 req-cc3121b2-c5a2-4e14-bfb3-d3043fff7ee9 tempest-MultipleCreateTestJSON-1931979633 tempest-MultipleCreateTestJSON-1931979633-project-member] Enqueued Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1097.906269] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3493b731-517b-4900-a67f-0d87ba7896a4 with Priority: HIGHEST for action security_group_members [ 1097.906584] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3493b731-517b-4900-a67f-0d87ba7896a4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.906707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.952474] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1097.952699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.952880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.953132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.953224] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.976661] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.097242] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.097512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.097512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.097857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.097988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.098162] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be updated. [ 1098.099618] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.099767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.099836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.100017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.100117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.100256] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1098.128373] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.128758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.128758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.128939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.129030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.131037] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.131189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.131261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.131461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.131603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.141688] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: IN_PROGRESS for 2s [ 1098.142401] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1098.221654] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75c45f18-eee4-4639-b07a-413cc1624dbc: rpc.has_security_group_logging(os_id): False [ 1098.242504] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.242847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.242955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.243252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.243379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.244458] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.244614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.244710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.244937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.245598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.245598] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75c45f18-eee4-4639-b07a-413cc1624dbc is going to be created. [ 1098.300095] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.300225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.300225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.300509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.300842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.315954] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c45f18-eee4-4639-b07a-413cc1624dbc in Status: IN_PROGRESS for 2s [ 1098.478839] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.484479] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.484643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.484714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.484934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.485035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.486015] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be deleted. [ 1098.542588] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.542588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.542588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.542588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.542588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.542588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.637594] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1098.637594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.863116] env[69358]: INFO networking_nsxv3.common.synchronization [req-edf3ce1c-c694-4e50-ab7e-da2302008ae9 req-d911c146-c90d-4c2e-b8f3-049ac5a29522 tempest-ServerPasswordTestJSON-1772909202 tempest-ServerPasswordTestJSON-1772909202-project-member] Enqueued Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGHEST for action security_group_members [ 1098.863116] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGHEST for action security_group_members [ 1098.864388] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e0950b-cead-448f-83c8-f0567e5a19e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.864388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.864388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.864666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.864863] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.864991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.865072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.865220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.865304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.865407] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.982359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.983029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.983029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.983029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.983412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.983530] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be updated. [ 1099.011225] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.011357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.011422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.011860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.012044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.022583] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: IN_PROGRESS for 2s [ 1099.214898] env[69358]: INFO networking_nsxv3.common.synchronization [None req-046c0476-6e2a-4645-9f0b-2effa81e16cc None None] Enqueued Resource ID: d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15 with Priority: HIGHEST for action port [ 1099.215579] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15 with Priority: HIGHEST for action port [ 1099.216295] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.216489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.216557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.216828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.217165] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.272456] env[69358]: INFO networking_nsxv3.common.synchronization [req-d0942cc8-b72a-44e9-b817-d81358954dfe req-3d6e5328-614e-4f25-96ae-1690560212bd tempest-ServerRescueNegativeTestJSON-1118501628 tempest-ServerRescueNegativeTestJSON-1118501628-project-member] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 1099.274754] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGHEST for action security_group_members [ 1099.274868] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.274971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.275170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.275431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.275665] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.275796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.275851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.275987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.276080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.276173] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.368661] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.368661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.368661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.368837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.368911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.369070] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.369180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.369243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.369403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.369490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.369576] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 already deleted. [ 1099.369657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.372555] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.372819] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.373113] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.373432] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.374518] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.374865] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.374943] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.375179] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.375387] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.375666] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.375903] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.375989] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.376060] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.377030] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.377209] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.377427] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.399588] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.399814] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1099.399987] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.400205] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-371" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.400530] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-954e1b0f-96ab-48fe-b49b-4904c57c61f9 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.400891] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-954e1b0f-96ab-48fe-b49b-4904c57c61f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.400891] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-954e1b0f-96ab-48fe-b49b-4904c57c61f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.401184] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-954e1b0f-96ab-48fe-b49b-4904c57c61f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.401330] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954e1b0f-96ab-48fe-b49b-4904c57c61f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.708881] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: SUCCESS [ 1099.709222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.709317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.709536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.709631] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.719489] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15 [ 1099.719589] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.719731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.719799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.720114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.720459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.720570] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15 already deleted. [ 1099.720949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d52b80cf-cfb8-4d6a-bcc0-76f1498f7d15" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.780216] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.780216] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.780216] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.780401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.780487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.780684] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.780783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.780844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.781097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.781217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.781287] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be updated. [ 1099.813564] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.813564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.813564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.813748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.813847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.833647] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: IN_PROGRESS for 2s [ 1099.904506] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.904506] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.904663] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.905072] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.905072] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.905230] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 954e1b0f-96ab-48fe-b49b-4904c57c61f9 not found, creating... [ 1099.906078] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.906078] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.906078] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.906078] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.906258] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.906471] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.906791] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.906791] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.908248] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.908410] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.908565] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 954e1b0f-96ab-48fe-b49b-4904c57c61f9 is going to be created. [ 1099.935408] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.935646] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.935774] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.936084] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.936362] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.936629] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-954e1b0f-96ab-48fe-b49b-4904c57c61f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.154243] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: IN_PROGRESS for 4s [ 1100.154970] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 4s [ 1100.200901] env[69358]: INFO networking_nsxv3.common.synchronization [req-6a9cf1dc-ce64-461d-bc1d-b20fc1fa99b4 req-33137bba-0f15-48be-977f-9e65cfc9d960 tempest-VolumesAdminNegativeTest-1170171242 tempest-VolumesAdminNegativeTest-1170171242-project-member] Enqueued Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_members [ 1100.201525] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 with Priority: HIGHEST for action security_group_members [ 1100.201920] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.202692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.202822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.203136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.203342] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.204250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.204250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.204250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.204250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.204250] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c21f0b2-3055-4df5-9afa-fd29cf1279d5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.211855] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.212022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.329144] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c45f18-eee4-4639-b07a-413cc1624dbc in Status: SUCCESS [ 1100.329144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.708243] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.708582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.708582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.708826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.710839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.711515] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.711515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.711515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.711667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.711743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.711870] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 is going to be updated. [ 1100.765717] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.765879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.765922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.766127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.766365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.775802] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 in Status: IN_PROGRESS for 2s [ 1100.795844] env[69358]: INFO networking_nsxv3.common.synchronization [req-edf3ce1c-c694-4e50-ab7e-da2302008ae9 req-8647af07-88fe-49e4-8553-81091006e511 service nova] Enqueued Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGHEST for action security_group_rules [ 1100.796099] env[69358]: INFO networking_nsxv3.common.synchronization [req-edf3ce1c-c694-4e50-ab7e-da2302008ae9 req-8647af07-88fe-49e4-8553-81091006e511 service nova] Enqueued Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGHEST for action security_group_members [ 1100.796315] env[69358]: INFO networking_nsxv3.common.synchronization [req-edf3ce1c-c694-4e50-ab7e-da2302008ae9 req-8647af07-88fe-49e4-8553-81091006e511 service nova] Enqueued Resource ID: 954e1b0f-96ab-48fe-b49b-4904c57c61f9 with Priority: HIGHEST for action port [ 1100.796884] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGHEST for action security_group_rules [ 1100.797120] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGHEST for action security_group_members [ 1100.797282] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e1b0f-96ab-48fe-b49b-4904c57c61f9 with Priority: HIGHEST for action port [ 1100.797743] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92e0950b-cead-448f-83c8-f0567e5a19e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.797949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.798063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.798384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.798539] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.799515] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e0950b-cead-448f-83c8-f0567e5a19e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.800632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.800632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.800632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.800632] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.800632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.800632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.800632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.800632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.800632] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.802015] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-954e1b0f-96ab-48fe-b49b-4904c57c61f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.802174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-954e1b0f-96ab-48fe-b49b-4904c57c61f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.802286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-954e1b0f-96ab-48fe-b49b-4904c57c61f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.802490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-954e1b0f-96ab-48fe-b49b-4904c57c61f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.802618] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954e1b0f-96ab-48fe-b49b-4904c57c61f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.034509] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3493b731-517b-4900-a67f-0d87ba7896a4 in Status: SUCCESS [ 1101.034735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.034916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.035153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.035339] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.035458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.035546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.035716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.035804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.035901] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3493b731-517b-4900-a67f-0d87ba7896a4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.303957] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.305249] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e0950b-cead-448f-83c8-f0567e5a19e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.305413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.305754] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 954e1b0f-96ab-48fe-b49b-4904c57c61f9 with status ACTIVE [ 1101.305970] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.306064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.306115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.306294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.306405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.306543] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.306637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.306700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.306847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.306923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.310785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.310911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.310981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.311315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.311413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.311510] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 954e1b0f-96ab-48fe-b49b-4904c57c61f9 is going to be updated. [ 1101.342332] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.342479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.342479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.342755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.342874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.343076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-954e1b0f-96ab-48fe-b49b-4904c57c61f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.522798] env[69358]: INFO networking_nsxv3.common.synchronization [None req-8a2c1358-651e-49c1-9361-3841c353da08 None None] Enqueued Resource ID: d8f4059c-1803-4f17-b040-cb30bc21700b with Priority: HIGHEST for action port [ 1101.523430] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f4059c-1803-4f17-b040-cb30bc21700b with Priority: HIGHEST for action port [ 1101.523744] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8f4059c-1803-4f17-b040-cb30bc21700b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.523872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8f4059c-1803-4f17-b040-cb30bc21700b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.523942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8f4059c-1803-4f17-b040-cb30bc21700b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.525516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8f4059c-1803-4f17-b040-cb30bc21700b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.525594] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8f4059c-1803-4f17-b040-cb30bc21700b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.538064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.538248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.538318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.538480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.538567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.538782] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.538902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.538939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.539099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.539181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.539270] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3493b731-517b-4900-a67f-0d87ba7896a4 is going to be deleted. [ 1101.570347] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.570531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.570629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.572018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.572018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.572018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3493b731-517b-4900-a67f-0d87ba7896a4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.689317] env[69358]: INFO networking_nsxv3.common.synchronization [req-4244ff51-6602-41a4-a986-aaeee3d555a4 req-9e09b928-041e-43c9-a7dd-f378cafa1560 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1101.690770] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1101.691150] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.691304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.691379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.691927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.691927] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.691927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.692103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.692136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.692225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.692341] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.806865] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.843683] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f22bfa82-0766-4940-b70e-28b7b023248e in Status: SUCCESS [ 1101.843859] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f22bfa82-0766-4940-b70e-28b7b023248e deletion is rescheduled due to dependency. [ 1101.843965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.027897] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8f4059c-1803-4f17-b040-cb30bc21700b [ 1102.029274] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.029274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.029274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.029274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.029274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.029274] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8f4059c-1803-4f17-b040-cb30bc21700b already deleted. [ 1102.029274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8f4059c-1803-4f17-b040-cb30bc21700b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.172025] env[69358]: INFO networking_nsxv3.common.synchronization [req-3e6bcc0e-2f85-44bf-a690-0b5c947934c1 req-7f5301f0-1e4f-4bc8-8e57-46bf381281af tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1102.176019] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: SUCCESS [ 1102.176019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.176019] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1102.176019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.176019] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1102.176019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.176019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.176019] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.176019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.176019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.177072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.177273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.177454] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.178777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.179068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.179324] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.179538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.179708] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.179987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.180167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.180334] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.182397] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.182647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.185017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.185017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.185017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.185017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.185017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.185017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.185017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.185017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.185017] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c6d0a7a3-cf02-4318-992a-866da08d6339 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1102.186922] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1102.187386] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.187578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.195778] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.309552] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.309727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.309802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.310039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.310133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.310235] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 is going to be created. [ 1102.334797] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.334950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.335035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.335247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.335424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.345047] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 in Status: UNINITIALIZED for 2s [ 1102.681036] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.682494] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.687152] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.696835] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.785298] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 in Status: SUCCESS [ 1102.785407] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c21f0b2-3055-4df5-9afa-fd29cf1279d5 deletion is rescheduled due to dependency. [ 1102.785542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c21f0b2-3055-4df5-9afa-fd29cf1279d5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.185475] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.186711] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.189429] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.198721] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.199054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.199180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.199467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.200141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.200307] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1103.229558] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.229707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.229763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.229996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.230128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.243022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1103.688364] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.688557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.688617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.688844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.688967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.689113] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be updated. [ 1103.690390] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.690534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.690634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.690847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.690937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.691041] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1103.694284] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.694430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.694523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.694720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.694833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.695124] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1103.719324] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.720961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.721166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.721412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.721558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.723634] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.723889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.723889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.724023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.724137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.725679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.725783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.725856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.726015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.726138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.735884] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1103.736601] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: IN_PROGRESS for 2s [ 1103.737224] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1103.849391] env[69358]: INFO networking_nsxv3.common.synchronization [req-4aeeac85-74a5-4345-8390-c938badf80c3 req-5ea7fa11-868c-4555-bca1-968202ce815d tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1103.849945] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1103.850274] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.850380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.186119] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.186452] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-792" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.186587] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-792" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.186959] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-792" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.187350] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.187627] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.187819] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.188139] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.188353] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.188758] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.188927] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.189106] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.189264] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.189422] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.189580] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.189782] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.223534] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.223882] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.224144] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.224434] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-792" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.225103] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-be600f67-7e57-494b-bc0d-b15128674d77 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.225363] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.225591] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.226064] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.226310] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be600f67-7e57-494b-bc0d-b15128674d77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.355171] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 in Status: SUCCESS [ 1104.355619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.355619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.355908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.356139] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.356340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.356340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.356592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.356732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.356844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.356941] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.539041] env[69358]: INFO networking_nsxv3.common.synchronization [req-7e6d10ef-cd94-4ddf-a77e-045ac9aba3e2 req-40331f94-241f-4d16-a8d1-c3425d314e4b tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1104.539568] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1104.539868] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.539992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.545434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.545908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.546232] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.546609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.546731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.547014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.547171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.547319] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.730053] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.730671] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.730889] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.731317] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.731592] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.731999] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port be600f67-7e57-494b-bc0d-b15128674d77 not found, creating... [ 1104.732499] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.732788] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.733014] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.733725] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.734194] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.734819] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.735475] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.735778] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.736167] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.736668] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.736911] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: be600f67-7e57-494b-bc0d-b15128674d77 is going to be created. [ 1104.761113] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.761504] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.761816] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.762415] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.762786] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.764634] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.859819] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e0950b-cead-448f-83c8-f0567e5a19e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.860029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.860096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.860430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.860516] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.860620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.860688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.860836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.860926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.861026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.861179] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e0950b-cead-448f-83c8-f0567e5a19e2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.861273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.861335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.861471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.861612] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.861729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.861818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.861966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.862076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.862337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.862399] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.954905] env[69358]: INFO networking_nsxv3.common.synchronization [req-bbb22f61-1d2d-416e-bfa2-16c2cebb7201 req-9d32c2aa-6d34-49be-966e-331ffa1e4808 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_members [ 1104.955569] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGHEST for action security_group_members [ 1104.955931] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.956102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.956173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.956405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.956586] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.956696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.956752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.956944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.957044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.957174] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.052940] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.052940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.052940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.052940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.052940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.052940] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.054252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.055035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.055309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.055520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.055707] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1105.081456] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.081879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.081879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.082447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.082534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.091469] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1105.259332] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1105.260376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.260376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.260376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.260376] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.260889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.260889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.260889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.260889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.260889] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.366080] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92e0950b-cead-448f-83c8-f0567e5a19e2: rpc.has_security_group_logging(os_id): False [ 1105.383207] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.383416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.383485] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.383668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.383765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.384014] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.384120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.384205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.384451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.384582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.384855] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.384960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.385098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.385272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.385356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.385682] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.385812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.385866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.385985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.386499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.386549] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 is going to be created. [ 1105.438562] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.438938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.439122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.439342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.439610] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.450288] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 in Status: IN_PROGRESS for 2s [ 1105.460076] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.460358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.460482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.460999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.460999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.461190] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.461341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.461341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.461650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.461750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.461868] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 is going to be updated. [ 1105.487902] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.488136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.488203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.488391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.488609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.500787] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 in Status: IN_PROGRESS for 2s [ 1105.549477] env[69358]: INFO networking_nsxv3.common.synchronization [req-4aeeac85-74a5-4345-8390-c938badf80c3 req-2b4f4042-b849-4937-865f-a1487e2c91da service nova] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1105.549477] env[69358]: INFO networking_nsxv3.common.synchronization [req-4aeeac85-74a5-4345-8390-c938badf80c3 req-2b4f4042-b849-4937-865f-a1487e2c91da service nova] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1105.549570] env[69358]: INFO networking_nsxv3.common.synchronization [req-4aeeac85-74a5-4345-8390-c938badf80c3 req-2b4f4042-b849-4937-865f-a1487e2c91da service nova] Enqueued Resource ID: be600f67-7e57-494b-bc0d-b15128674d77 with Priority: HIGHEST for action port [ 1105.550417] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1105.550633] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1105.551156] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be600f67-7e57-494b-bc0d-b15128674d77 with Priority: HIGHEST for action port [ 1105.551867] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.551867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.552236] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.552365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.552679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-be600f67-7e57-494b-bc0d-b15128674d77 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.553157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.553157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.553275] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.553430] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be600f67-7e57-494b-bc0d-b15128674d77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.749058] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1105.749325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.749475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.749706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.749999] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.750136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.750205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.750359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.750441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.750527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.750688] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.750767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.750829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.750964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.751112] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.751206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.751272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.751397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.751605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.751605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.751703] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.753075] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1105.753254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.753920] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: SUCCESS [ 1105.754125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.754270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.754433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.754585] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.754689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.754836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.754892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.755132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.755132] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.756314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.756508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.756702] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.756943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.757050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.757202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.757283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.757370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.757457] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.767079] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.767236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.767540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.767670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.767799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.768010] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.768121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.768186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.768347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.768424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.768511] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1105.793129] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.793282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.794393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.794393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.794393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.804393] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1106.058654] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be600f67-7e57-494b-bc0d-b15128674d77 with status ACTIVE [ 1106.058892] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.059040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.059111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.059334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.059431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.059614] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.059713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.059821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.059918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.060029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.061880] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.061880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.061880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.061880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.061880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.061880] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be600f67-7e57-494b-bc0d-b15128674d77 is going to be updated. [ 1106.080515] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.080670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.080744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.080969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.081204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.081387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.259601] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.260686] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4335c702-c854-428a-bca2-25e63a950287: rpc.has_security_group_logging(os_id): False [ 1106.261912] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.279506] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.279641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.279641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.280714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.280714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.280714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.280714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.280714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.280714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.280714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.280957] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.280957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.280957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.281143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.281143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.281362] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.281455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.281513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.281675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.281752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.281835] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1106.339177] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.339177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.339177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.339177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.339177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.363259] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1106.762752] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.764019] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5b54a11-30a4-4b59-9e2e-3429b26a65f9: rpc.has_security_group_logging(os_id): False [ 1106.786655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.786655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.786655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.786851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.786851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.787058] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.787164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.787227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.787374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.787450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.787582] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be updated. [ 1106.848838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.849019] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.849067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.849262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.849436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.863677] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: IN_PROGRESS for 2s [ 1107.102878] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1107.103466] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 1107.103466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.267870] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.267870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.267870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.268497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.268497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.268497] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1107.295927] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.296147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.296224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.296465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.297128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.306156] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1107.461507] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 in Status: SUCCESS [ 1107.461866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.510137] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 in Status: SUCCESS [ 1107.510333] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 deletion is rescheduled due to dependency. [ 1107.510446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.817072] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1107.817262] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c deletion is rescheduled due to dependency. [ 1107.817374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.831946] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-866 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.832165] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.832292] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.832558] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.832823] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.832986] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.833124] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.833340] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.833487] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.833701] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.834020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.834020] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.834108] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.834148] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.834261] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.834393] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.853557] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.853726] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.853867] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.854054] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.854367] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-1938e39c-0709-4420-a5e2-70a0285228a6 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.854540] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.854662] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.854920] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.855072] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1938e39c-0709-4420-a5e2-70a0285228a6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.358134] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.358436] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.358573] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.358926] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.360265] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.360265] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.360265] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.360265] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.360265] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.360265] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.360563] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.360563] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.360675] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.360834] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.360988] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.361216] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 1938e39c-0709-4420-a5e2-70a0285228a6 is going to be updated. [ 1108.376890] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1108.377182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.377416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.377812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.377949] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.381679] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.381771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.381929] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.382112] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.382340] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.382653] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.878091] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: SUCCESS [ 1108.878388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.879945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.880076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.081553] env[69358]: INFO networking_nsxv3.common.synchronization [req-3db359a3-21c9-48f6-a745-4bee5f31a227 req-ca06b24f-2004-4bb8-9766-3d0cb5593a69 service nova] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_rules [ 1109.081835] env[69358]: INFO networking_nsxv3.common.synchronization [req-3db359a3-21c9-48f6-a745-4bee5f31a227 req-ca06b24f-2004-4bb8-9766-3d0cb5593a69 service nova] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_members [ 1109.082089] env[69358]: INFO networking_nsxv3.common.synchronization [req-3db359a3-21c9-48f6-a745-4bee5f31a227 req-ca06b24f-2004-4bb8-9766-3d0cb5593a69 service nova] Enqueued Resource ID: 1938e39c-0709-4420-a5e2-70a0285228a6 with Priority: HIGHEST for action port [ 1109.082801] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_rules [ 1109.082992] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_members [ 1109.083159] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1938e39c-0709-4420-a5e2-70a0285228a6 with Priority: HIGHEST for action port [ 1109.083557] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.083729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.083831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.084156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.084305] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.085484] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.085659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.085765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.086052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.086314] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.086481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.086581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.086808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.086936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.087111] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.088244] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-1938e39c-0709-4420-a5e2-70a0285228a6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.088393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.088523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.088763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.088957] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1938e39c-0709-4420-a5e2-70a0285228a6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.316902] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1109.316902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.316902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.317094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.317827] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.317827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.317827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.317827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.319386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.319386] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.590756] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.591834] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.591945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.592147] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1938e39c-0709-4420-a5e2-70a0285228a6 with status ACTIVE [ 1109.592344] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.592482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.592569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.592823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.592951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.593184] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.593273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.593353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.593554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.593634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.593852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.593969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.594061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.594225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.594428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.594428] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1938e39c-0709-4420-a5e2-70a0285228a6 is going to be updated. [ 1109.614813] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.614986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.615036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.615238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.615466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.615593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1938e39c-0709-4420-a5e2-70a0285228a6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.824466] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.096144] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.327043] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.602925] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.602925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.602925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.602925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.603414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.603414] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada is going to be updated. [ 1110.627014] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.627263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.627339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.627681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.628560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.636611] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: IN_PROGRESS for 2s [ 1110.829883] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.830084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.830161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.830385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.830470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.830571] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1110.857378] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.857638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.857696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.857968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.858136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.868562] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1112.602646] env[69358]: INFO networking_nsxv3.common.synchronization [req-2cf94de9-b053-4b03-b917-4e112920ac84 req-155b0e79-0c5b-484b-9d78-21bbbe0a87cd tempest-ServerPasswordTestJSON-1772909202 tempest-ServerPasswordTestJSON-1772909202-project-member] Enqueued Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGHEST for action security_group_members [ 1112.603244] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGHEST for action security_group_members [ 1112.603592] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e0950b-cead-448f-83c8-f0567e5a19e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.603755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.603849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.604068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.604227] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.604314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.604383] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.604525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.604609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.604700] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.645434] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: SUCCESS [ 1112.645717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.645891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.646119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.646307] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.646419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.646495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.646624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.646706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.646789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.646896] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.877896] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1112.878178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.878178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.878410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.878736] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.878970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.878970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.879438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.879533] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.879649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.879784] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.110096] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.110096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.110096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.110096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.110096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.110096] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.110096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.110096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.110096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.110096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.110096] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 is going to be updated. [ 1113.136206] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.136546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.136711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.137013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.137248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.145177] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 in Status: IN_PROGRESS for 2s [ 1113.148649] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.382419] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.382719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.382719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.382951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.383142] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.383247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.383315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.383467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.383556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.383725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.383796] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.383873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.383929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.384080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.384239] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.384342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.384403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.384647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.384647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.384740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.384836] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.651494] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6bcbfacc-e75b-4ac4-81ab-350530d27ada: rpc.has_security_group_logging(os_id): False [ 1113.671237] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.671237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.671237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.671237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.671237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.671237] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.671237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.671237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.671237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.671237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.671237] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada is going to be updated. [ 1113.724552] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.724552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.724552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.724552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.725039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.737724] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: IN_PROGRESS for 2s [ 1113.887068] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4335c702-c854-428a-bca2-25e63a950287: rpc.has_security_group_logging(os_id): False [ 1113.905570] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.905759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.905826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.906062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.906186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.906458] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.906559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.906621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.906778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.907433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.907433] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.907433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.907433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.907433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.907433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.907831] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.907831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.907831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.908072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.908465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.908574] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1113.965563] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.965817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.965817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.966162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.966401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.986934] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1114.578467] env[69358]: INFO networking_nsxv3.common.synchronization [req-452b24e1-f985-4205-b29a-beb51235d1ac req-3780faf0-5c55-4e10-8aff-b31fcd81425a tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1114.579857] env[69358]: INFO networking_nsxv3.common.synchronization [req-452b24e1-f985-4205-b29a-beb51235d1ac req-3780faf0-5c55-4e10-8aff-b31fcd81425a tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1114.581664] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1114.581895] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1114.582792] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff28f53-3608-4780-aa3e-3e63adf69fe8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.583650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.583784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.584114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.584350] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.584506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.584606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.584839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.585013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.585237] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.587107] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.587107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.587107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.587525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.587758] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.587998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.588157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.588403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.588553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.588707] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.657943] env[69358]: INFO networking_nsxv3.common.synchronization [req-452b24e1-f985-4205-b29a-beb51235d1ac req-3780faf0-5c55-4e10-8aff-b31fcd81425a tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_rules [ 1114.658267] env[69358]: INFO networking_nsxv3.common.synchronization [req-452b24e1-f985-4205-b29a-beb51235d1ac req-3780faf0-5c55-4e10-8aff-b31fcd81425a tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1114.658373] env[69358]: INFO networking_nsxv3.common.synchronization [req-452b24e1-f985-4205-b29a-beb51235d1ac req-3780faf0-5c55-4e10-8aff-b31fcd81425a tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1114.658562] env[69358]: INFO networking_nsxv3.common.synchronization [req-452b24e1-f985-4205-b29a-beb51235d1ac req-3780faf0-5c55-4e10-8aff-b31fcd81425a tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1114.658804] env[69358]: INFO networking_nsxv3.common.synchronization [req-452b24e1-f985-4205-b29a-beb51235d1ac req-3780faf0-5c55-4e10-8aff-b31fcd81425a tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: be600f67-7e57-494b-bc0d-b15128674d77 with Priority: HIGHEST for action port [ 1114.659539] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_rules [ 1114.659747] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1114.659924] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be600f67-7e57-494b-bc0d-b15128674d77 with Priority: HIGHEST for action port [ 1114.660075] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1114.660232] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1114.660789] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.660951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.661095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.661410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.661504] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.662580] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.662580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.662826] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-be600f67-7e57-494b-bc0d-b15128674d77 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.662882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.662954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.663257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.663319] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be600f67-7e57-494b-bc0d-b15128674d77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.672461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff28f53-3608-4780-aa3e-3e63adf69fe8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.672461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.672461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.672461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.092902] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.092902] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.156687] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 in Status: SUCCESS [ 1115.156964] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 deletion is rescheduled due to dependency. [ 1115.157062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.171612] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be600f67-7e57-494b-bc0d-b15128674d77 with status ACTIVE [ 1115.171896] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.172229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.172306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.172525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.172694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.172793] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.172889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.172951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.173116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.173196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.173375] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.173467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.173637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.173696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.173792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.173876] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be600f67-7e57-494b-bc0d-b15128674d77 is going to be updated. [ 1115.175169] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff28f53-3608-4780-aa3e-3e63adf69fe8 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.175264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.195123] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.195251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.195314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.195532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.195678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.195855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.593538] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.594614] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.755252] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: SUCCESS [ 1115.758769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.801536] env[69358]: INFO networking_nsxv3.common.synchronization [req-bae68d9f-3713-4b07-9d85-a6da1e3670f9 req-e2b97566-c115-40bb-8595-e31f882a5851 tempest-ListImageFiltersTestJSON-1857961629 tempest-ListImageFiltersTestJSON-1857961629-project-member] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1115.802189] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1115.802582] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.802741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.802771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.802989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.804102] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.804273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.804371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.805267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.805267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.805267] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.999068] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1115.999422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.999647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.999810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.999928] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.096254] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.096704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.100213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.100557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.100653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.100775] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 is going to be created. [ 1116.102858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.102997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.102997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.103241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.103354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.103452] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1116.142549] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.142723] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.142801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.143105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.143276] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.146161] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.146512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.146736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.146972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.147258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.160193] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1116.160954] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 in Status: UNINITIALIZED for 2s [ 1116.307311] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.503174] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.503319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.811150] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.315642] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.315853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.315916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.316115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.316205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.316303] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb is going to be updated. [ 1117.346989] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.347192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.347270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.347516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.347675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.358849] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: IN_PROGRESS for 2s [ 1118.184026] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1118.184880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.184880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.184880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.184880] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.184880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.184880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.185199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.185199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.185309] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.188677] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 in Status: SUCCESS [ 1118.188752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.188859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.189050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.189229] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.189345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.189408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.189552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.189633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.189726] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.664719] env[69358]: INFO networking_nsxv3.common.synchronization [req-40f8c513-ffb7-4a8d-b444-9022cf399a8e req-9604e390-2683-4c8a-a333-dc9b3fcc02d7 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1118.664719] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1118.664719] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.664719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.664719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.665181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.665181] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.665181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.665181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.665375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.665429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.665553] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.691772] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.692702] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.124221] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.124596] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.124895] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.127262] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.127815] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.128128] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.128429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.130687] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.130980] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.131434] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.131776] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.132032] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.133312] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.133503] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.133738] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.134113] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.153469] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.153756] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1119.153983] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.154375] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.154863] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-32466da2-b8a7-4215-9a30-4112717e9ee8 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.155164] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-32466da2-b8a7-4215-9a30-4112717e9ee8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.155376] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-32466da2-b8a7-4215-9a30-4112717e9ee8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.155923] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-32466da2-b8a7-4215-9a30-4112717e9ee8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.156252] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32466da2-b8a7-4215-9a30-4112717e9ee8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.168075] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.168389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.168707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.169012] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.169204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.169607] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.169750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.169819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.170074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.170203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.170480] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b already deleted. [ 1119.170480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.194247] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.195887] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.369522] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: SUCCESS [ 1119.369993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.660352] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.660624] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.660827] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.661136] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.661286] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.661449] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 32466da2-b8a7-4215-9a30-4112717e9ee8 not found, creating... [ 1119.661769] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.661990] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.662137] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.662374] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.662519] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.662818] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.662981] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.663115] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.663331] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.663468] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.663675] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 32466da2-b8a7-4215-9a30-4112717e9ee8 is going to be created. [ 1119.685434] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.687743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.687743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.687743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.687743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.687743] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-32466da2-b8a7-4215-9a30-4112717e9ee8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.697834] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.698030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.698107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.698476] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.698578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.698731] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1119.702960] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.702960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.702960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.702960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.702960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.702960] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 is going to be updated. [ 1119.725268] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.725478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.725568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.725790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.725926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.728154] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.728154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.728154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.728335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.728425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.737839] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1119.739414] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 in Status: IN_PROGRESS for 2s [ 1120.473564] env[69358]: INFO networking_nsxv3.common.synchronization [req-40f8c513-ffb7-4a8d-b444-9022cf399a8e req-2e5be511-97f7-477c-9f7c-a0f260dc1868 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1120.473564] env[69358]: INFO networking_nsxv3.common.synchronization [req-40f8c513-ffb7-4a8d-b444-9022cf399a8e req-2e5be511-97f7-477c-9f7c-a0f260dc1868 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1120.473835] env[69358]: INFO networking_nsxv3.common.synchronization [req-40f8c513-ffb7-4a8d-b444-9022cf399a8e req-2e5be511-97f7-477c-9f7c-a0f260dc1868 service nova] Enqueued Resource ID: 32466da2-b8a7-4215-9a30-4112717e9ee8 with Priority: HIGHEST for action port [ 1120.474022] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1120.474085] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1120.474159] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32466da2-b8a7-4215-9a30-4112717e9ee8 with Priority: HIGHEST for action port [ 1120.475592] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.475592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.475592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.475592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.475592] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.476761] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.476893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.476963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.477162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.477315] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.477414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.477496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.478311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.478406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.478514] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.484028] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-32466da2-b8a7-4215-9a30-4112717e9ee8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.484028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32466da2-b8a7-4215-9a30-4112717e9ee8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.484028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32466da2-b8a7-4215-9a30-4112717e9ee8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.484028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32466da2-b8a7-4215-9a30-4112717e9ee8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.484028] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32466da2-b8a7-4215-9a30-4112717e9ee8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.988532] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32466da2-b8a7-4215-9a30-4112717e9ee8 with status ACTIVE [ 1120.989074] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.989410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.989577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.989931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.990195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.990773] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.990773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.990905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.991219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.991522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.992065] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.992065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.992249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.992631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.993528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.993820] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32466da2-b8a7-4215-9a30-4112717e9ee8 is going to be updated. [ 1120.995834] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.995959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.996327] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.019284] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.019284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.019284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.019284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.019284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.019284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32466da2-b8a7-4215-9a30-4112717e9ee8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.253550] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1121.253627] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1121.253794] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf with Priority: HIGHEST for action security_group_members [ 1121.254325] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1121.254488] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1121.254602] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf with Priority: HIGHEST for action security_group_members [ 1121.254875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff28f53-3608-4780-aa3e-3e63adf69fe8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.255030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.256385] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.256385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.256385] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e351a9c-1fc2-450a-a0bb-7febee9957cf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.256385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.256385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.256385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.256712] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.256712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.256712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.256848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.256848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.256931] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.300754] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_rules [ 1121.300951] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1121.301137] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1121.301276] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1121.301431] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf with Priority: HIGHEST for action security_group_rules [ 1121.301578] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf with Priority: HIGHEST for action security_group_members [ 1121.304486] env[69358]: INFO networking_nsxv3.common.synchronization [req-9f851166-4311-40b8-ae0c-3b11787f4f68 req-c6f9e84f-ff1c-46c1-b8f8-a9cbede8fe40 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: be600f67-7e57-494b-bc0d-b15128674d77 with Priority: HIGHEST for action port [ 1121.304486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_rules [ 1121.304486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_rules [ 1121.304486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf with Priority: HIGHEST for action security_group_members [ 1121.304486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be600f67-7e57-494b-bc0d-b15128674d77 with Priority: HIGHEST for action port [ 1121.304486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf with Priority: HIGHEST for action security_group_rules [ 1121.304486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1121.304486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1121.304486] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.304486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.304486] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.304486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.304486] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e351a9c-1fc2-450a-a0bb-7febee9957cf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.304486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.304486] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-be600f67-7e57-494b-bc0d-b15128674d77 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.304486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.304486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.304486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.305822] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be600f67-7e57-494b-bc0d-b15128674d77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.305822] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e351a9c-1fc2-450a-a0bb-7febee9957cf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.305822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.305822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.305993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.306075] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.306815] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff28f53-3608-4780-aa3e-3e63adf69fe8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.306922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.307124] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.307211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.499873] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.753893] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1121.754157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.754880] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 in Status: SUCCESS [ 1121.755099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.755246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.755512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.755724] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.755893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.755929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.756090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.757109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.757109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.757109] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.757232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.757510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.757510] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.757631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.757661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.757783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.757856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.757933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.758035] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.758966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.759144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.759326] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.759430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.759486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.759584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.759657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.759736] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.760342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.761831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.761831] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.761831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.761831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.761831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.761831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.761831] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.761831] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.809264] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e351a9c-1fc2-450a-a0bb-7febee9957cf taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.809264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.809264] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be600f67-7e57-494b-bc0d-b15128674d77 with status ACTIVE [ 1121.809553] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.809553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.809553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.810777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.810777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.811547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.811547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.811547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.811547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.811864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.811948] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.819023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.819023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.819023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.819023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.819023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be600f67-7e57-494b-bc0d-b15128674d77 is going to be updated. [ 1121.862850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.862985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.863065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.863272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.863412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.863584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be600f67-7e57-494b-bc0d-b15128674d77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.002404] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.002404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.002615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.002670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.002800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.002850] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be created. [ 1122.041425] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.041497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.041567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.041779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.041930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.051490] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: UNINITIALIZED for 2s [ 1122.260153] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.260153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.265027] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.265027] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.265027] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.265469] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.768152] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.769399] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.772484] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ff28f53-3608-4780-aa3e-3e63adf69fe8: rpc.has_security_group_logging(os_id): False [ 1122.772484] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.773191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.773191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.773374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.773374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.773374] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf is going to be created. [ 1122.793405] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.793553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.793614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.793846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.793928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.794144] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.794247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.794312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.794466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.794545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.794630] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 is going to be created. [ 1122.802775] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.802905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.802973] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.803149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.803294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.811551] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf in Status: UNINITIALIZED for 2s [ 1122.885346] env[69358]: INFO networking_nsxv3.common.synchronization [req-6b534c51-9181-4707-bea7-46ad1a691c88 req-963e7d17-dac2-4990-ac58-e512ccb57e85 tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1122.885968] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1122.886314] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.886446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.886517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.886737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.886893] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.887045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.890380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.890487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.890487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.890673] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.901293] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.901472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.901610] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.901689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.901852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.914770] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 in Status: IN_PROGRESS for 2s [ 1123.275577] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.279022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.279022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.279022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.279022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.279022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1123.279022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.279022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.279022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.279022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.279022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.279022] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 is going to be updated. [ 1123.311997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.311997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.311997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.311997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.311997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.311997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.311997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.311997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.311997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.313169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.322988] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1123.322988] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 in Status: IN_PROGRESS for 2s [ 1123.396338] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.396338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.396338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.396338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.396338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.396338] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.396338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.396338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.396338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.396338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.396338] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1123.398894] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.399298] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.399933] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.400416] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.400784] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.401094] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.401986] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.401986] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.401986] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.401986] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.401986] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.402202] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.402202] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.402318] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.402428] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.402561] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.419765] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.419974] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1123.420138] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.420344] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.420681] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-f548e2aa-9445-4c48-8501-52dd871b0e6a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.420854] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-f548e2aa-9445-4c48-8501-52dd871b0e6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.420980] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-f548e2aa-9445-4c48-8501-52dd871b0e6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.421369] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-f548e2aa-9445-4c48-8501-52dd871b0e6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.421488] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f548e2aa-9445-4c48-8501-52dd871b0e6a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.425258] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.425258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.425258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.425258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.425258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.431551] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1123.929023] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.929023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.929023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.929023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.929023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.929023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port f548e2aa-9445-4c48-8501-52dd871b0e6a not found, creating... [ 1123.929023] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.929023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.929023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.929023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.929023] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.937100] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.937100] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.937100] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.937100] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.937100] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.937100] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: f548e2aa-9445-4c48-8501-52dd871b0e6a is going to be created. [ 1123.957861] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.959818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.959818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.959818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.959818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.959818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-f548e2aa-9445-4c48-8501-52dd871b0e6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.062763] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1124.062763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.062763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.062763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.062763] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.062763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.062763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.062763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.062763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.062763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.062763] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.459648] env[69358]: INFO networking_nsxv3.common.synchronization [req-ec4de117-58b0-4936-ad83-62fb78357888 req-9fa29697-b7a7-49df-9d31-3f5bc2561a44 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf with Priority: HIGHEST for action security_group_members [ 1124.459808] env[69358]: INFO networking_nsxv3.common.synchronization [req-ec4de117-58b0-4936-ad83-62fb78357888 req-9fa29697-b7a7-49df-9d31-3f5bc2561a44 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1124.459960] env[69358]: INFO networking_nsxv3.common.synchronization [req-ec4de117-58b0-4936-ad83-62fb78357888 req-9fa29697-b7a7-49df-9d31-3f5bc2561a44 tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1124.460932] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf with Priority: HIGHEST for action security_group_members [ 1124.461944] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 with Priority: HIGHEST for action security_group_members [ 1124.462115] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1124.462475] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e351a9c-1fc2-450a-a0bb-7febee9957cf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.462595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.462875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff28f53-3608-4780-aa3e-3e63adf69fe8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.462965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.463206] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.463332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.565898] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.565898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.565898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.565898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.565898] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.565898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.565898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.565898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.565898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.566363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.566363] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.566363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.566363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.567034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.567034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.567034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.567034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.567357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.567357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.567357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.567357] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.719427] env[69358]: INFO networking_nsxv3.common.synchronization [req-6b534c51-9181-4707-bea7-46ad1a691c88 req-aee0e61b-4ac4-40f9-8129-137bddd0527c service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 1124.719427] env[69358]: INFO networking_nsxv3.common.synchronization [req-6b534c51-9181-4707-bea7-46ad1a691c88 req-aee0e61b-4ac4-40f9-8129-137bddd0527c service nova] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1124.719427] env[69358]: INFO networking_nsxv3.common.synchronization [req-6b534c51-9181-4707-bea7-46ad1a691c88 req-aee0e61b-4ac4-40f9-8129-137bddd0527c service nova] Enqueued Resource ID: f548e2aa-9445-4c48-8501-52dd871b0e6a with Priority: HIGHEST for action port [ 1124.719878] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_rules [ 1124.720023] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1124.720120] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f548e2aa-9445-4c48-8501-52dd871b0e6a with Priority: HIGHEST for action port [ 1124.720634] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.720779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.720852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.721041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.721127] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.722063] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.722063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.722213] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-f548e2aa-9445-4c48-8501-52dd871b0e6a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.722309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f548e2aa-9445-4c48-8501-52dd871b0e6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.722377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f548e2aa-9445-4c48-8501-52dd871b0e6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.722528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f548e2aa-9445-4c48-8501-52dd871b0e6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.722604] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f548e2aa-9445-4c48-8501-52dd871b0e6a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.822255] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf in Status: SUCCESS [ 1124.822364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.822512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.822765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.822953] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.823080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.823148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.823296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.823381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.823478] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.928936] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 in Status: SUCCESS [ 1124.928936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.929310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.929310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.929310] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.070423] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b: rpc.has_security_group_logging(os_id): False [ 1125.088352] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.088617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.088711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.088926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.089029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.089233] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.089330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.089395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.089546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.089623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.089834] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.089922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.089977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.090225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.090225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.090417] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.090512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.090572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.090711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.090785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.090868] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be created. [ 1125.149344] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.149523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.149615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.149853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.150078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.161934] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1125.226858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.226858] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f548e2aa-9445-4c48-8501-52dd871b0e6a with status ACTIVE [ 1125.226858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.226858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.226858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.226858] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.227460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.227460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.227460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.227460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.227460] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f548e2aa-9445-4c48-8501-52dd871b0e6a is going to be updated. [ 1125.267694] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.267877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.267928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.268281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.271028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.271028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f548e2aa-9445-4c48-8501-52dd871b0e6a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.325744] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.325879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.325966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.326163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.326464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.326464] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.327151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.327151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.327151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.327151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.327151] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf is going to be deleted. [ 1125.332752] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 in Status: SUCCESS [ 1125.332950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.333111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.333283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.333441] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.333540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.333604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.333746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.333825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.333917] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.335394] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1125.335555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.335666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.335819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.335969] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.336077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.336145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.336287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.336364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.336451] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.386135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.386301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.386539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.386629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.386695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.386808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.386975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.387192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.387396] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.387524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.387621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.387733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.387822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.387997] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.449071] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1125.449252] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 1125.449405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.449528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.449814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.449998] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.450126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.450190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.450391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.450490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.450673] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.462706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.462892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.462892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.463083] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.463170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.463502] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 is going to be deleted. [ 1125.528971] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.529156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.529197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.529443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.529541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.529656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.837989] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.838180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.838180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.838317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.838435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.838623] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.838721] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.838785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.838941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.839026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.839127] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 is going to be deleted. [ 1125.840275] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.867283] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.867457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.867532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.867803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.867903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.868013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.868425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.868596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.868760] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.868859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.868923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.869079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.869158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.869249] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ff28f53-3608-4780-aa3e-3e63adf69fe8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.890273] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.890462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.890531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.890706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.891193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.891193] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.891193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.891193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.891399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.891434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.891526] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf already deleted. [ 1125.891573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.891676] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.892467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.892642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.892790] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.892905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.892989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.893117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.893203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.893286] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.953020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.342182] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.371840] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.371997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.372107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.372288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.372380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.372575] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.372668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.372718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.372865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.372955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.373031] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff28f53-3608-4780-aa3e-3e63adf69fe8 already deleted. [ 1126.373104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff28f53-3608-4780-aa3e-3e63adf69fe8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.394302] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e351a9c-1fc2-450a-a0bb-7febee9957cf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.395867] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.395867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.396109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.396163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.396296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.397033] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.397033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.397033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.397033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.397033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.397317] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf already deleted. [ 1126.397317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.455950] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.664347] env[69358]: INFO networking_nsxv3.common.synchronization [None req-23930ac2-7089-4eeb-8c89-a6f1d0d2ece3 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_rules [ 1126.664906] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_rules [ 1126.665391] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.665540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.665619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.665904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.666023] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.742448] env[69358]: INFO networking_nsxv3.common.synchronization [None req-08196cf9-7ac2-4ca8-bcd6-38625f022d75 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_rules [ 1126.742908] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_rules [ 1126.743227] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.743335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.851072] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.851233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.851295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.851521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.852161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.852161] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1126.879188] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.879335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.879452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.879621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.879784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.889498] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1126.897851] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e351a9c-1fc2-450a-a0bb-7febee9957cf: rpc.has_security_group_logging(os_id): False [ 1126.917483] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.917661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.917707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.917894] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.917997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.918253] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.918522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.918589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.918758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.918840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.918927] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf is going to be created. [ 1126.944547] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/8e351a9c-1fc2-450a-a0bb-7febee9957cf], does not exist path=[/infra/domains/default/groups/8e351a9c-1fc2-450a-a0bb-7febee9957cf]."\n}' [ 1126.944691] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8e351a9c-1fc2-450a-a0bb-7febee9957cf [ 1126.944925] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1126.958755] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.959078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.959078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.959230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.959273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.959348] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1126.984813] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.984989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.985075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.985298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.985444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.994851] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1126.996663] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.996809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.996881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.997086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.998660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.998937] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.999059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.999118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.999279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.999357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.999552] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.999724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.999724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.999832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.999902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.999984] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e351a9c-1fc2-450a-a0bb-7febee9957cf is going to be created. [ 1127.020282] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/8e351a9c-1fc2-450a-a0bb-7febee9957cf], does not exist path=[/infra/domains/default/groups/8e351a9c-1fc2-450a-a0bb-7febee9957cf]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8e351a9c-1fc2-450a-a0bb-7febee9957cf [ 1127.020402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e351a9c-1fc2-450a-a0bb-7febee9957cf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.020944] env[69358]: Traceback (most recent call last): [ 1127.021018] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1127.021018] env[69358]: return func(*args, **kwargs) [ 1127.021018] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1127.021018] env[69358]: res.raise_for_status() [ 1127.021018] env[69358]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1127.021018] env[69358]: raise HTTPError(http_error_msg, response=self) [ 1127.021018] env[69358]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8e351a9c-1fc2-450a-a0bb-7febee9957cf [ 1127.021018] env[69358]: During handling of the above exception, another exception occurred: [ 1127.021018] env[69358]: Traceback (most recent call last): [ 1127.021018] env[69358]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1127.021018] env[69358]: listener.cb(fileno) [ 1127.021018] env[69358]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1127.021018] env[69358]: result = function(*args, **kwargs) [ 1127.021018] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1127.021018] env[69358]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1127.021018] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1127.021018] env[69358]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1127.021018] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1127.021018] env[69358]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1127.021018] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1127.021018] env[69358]: res.raise_for_status() [ 1127.021018] env[69358]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1127.021018] env[69358]: raise HTTPError(http_error_msg, response=self) [ 1127.021018] env[69358]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8e351a9c-1fc2-450a-a0bb-7febee9957cf [ 1127.021018] env[69358]: Removing descriptor: 5 [ 1127.176202] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1127.176442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.187523] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.187873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.187873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.188084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.188084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.188217] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 662b0a83-6546-43c9-93f7-23997583fecf already deleted. [ 1127.188261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.188880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.188999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.189058] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.719674] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.719836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.719876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.720106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.720203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.720300] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 662b0a83-6546-43c9-93f7-23997583fecf already deleted. [ 1127.720376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.165372] env[69358]: INFO networking_nsxv3.common.synchronization [req-4f17dd21-38e9-4d66-97cf-fcdfefb70f2c req-545776de-7b68-4198-ac32-83fdb6cb0b66 tempest-AttachVolumeTestJSON-45129221 tempest-AttachVolumeTestJSON-45129221-project-member] Enqueued Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_members [ 1128.165372] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGHEST for action security_group_members [ 1128.165714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.165714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.165806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.165968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.166779] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.166992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.167130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.167828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.167828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.167828] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.671680] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.671799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.671832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.672078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.691405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.691657] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.691821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.691864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.692038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.692119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.692256] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 is going to be updated. [ 1128.720243] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.720243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.720243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.720243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.720243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.727087] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 in Status: IN_PROGRESS for 2s [ 1128.899882] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1128.900113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.900289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.900557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.901410] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.901410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.901410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.901410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.901410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.901410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.901679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.901679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.901679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.901956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.901956] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.901956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.902427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.903412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.905082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.905082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.905082] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.905474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.905638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.905787] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.905884] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.905947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.906097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.906166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.906258] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.005783] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1129.006033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.006202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.006420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.006617] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.006736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.006802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.006981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.008981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.008981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.008981] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.408051] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4335c702-c854-428a-bca2-25e63a950287: rpc.has_security_group_logging(os_id): False [ 1129.412077] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.425807] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.426013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.426148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.426422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.448234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.448761] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.449312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.449312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.449494] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.449559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.449853] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.449999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.450676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.450676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.450676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.450878] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.451380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.451536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.451922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.452144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.452412] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1129.510198] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.510671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.510968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.511754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.511850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.512703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.512703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.512703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.512703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.512886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.512941] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.513050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.513089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.513485] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.513485] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.513485] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.513656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.513656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.513724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.514100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.514100] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.518327] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.518450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.518503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.518667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.518820] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.533746] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1129.914525] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.016336] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d904f37a-b3f7-4aef-9721-265081cb343b: rpc.has_security_group_logging(os_id): False [ 1130.039459] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.039459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.039459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.039459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.056491] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.056651] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.057274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.057274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.057274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.057520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.057771] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.057885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.057954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.058183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.058272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.058477] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.058598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.058654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.058801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.058880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.058967] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1130.118458] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.118659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.118735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.118960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.119105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.133830] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1130.418051] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.418051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.418051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.418051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.418051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.418051] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1130.443738] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.443913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.443956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.444793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.444793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.451827] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1130.735695] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 in Status: SUCCESS [ 1130.735879] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 deletion is rescheduled due to dependency. [ 1130.735997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.413440] env[69358]: INFO networking_nsxv3.common.synchronization [req-17007a38-f37c-4c7e-90bf-4e4aa07e0a68 req-4c367551-3922-4810-8f7e-d04385905c33 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1131.413440] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1131.413440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.413440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.413440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.413440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.413440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.413440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.413440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.413440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.413440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.413440] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.550539] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1131.550933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.551086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.551388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.551479] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.916803] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.916803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.916983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.917125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.937887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.938250] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.938412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.938492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.938695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.939259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.939259] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1131.961638] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.961785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.961845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.962244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.962244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.969579] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1132.049045] env[69358]: INFO networking_nsxv3.common.synchronization [None req-a4da5cc9-f67d-4835-a48b-b260fc9e0701 None None] Enqueued Resource ID: 088d1fc5-dd9c-45fb-8610-49da8f0c493d with Priority: HIGHEST for action port [ 1132.049045] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 088d1fc5-dd9c-45fb-8610-49da8f0c493d with Priority: HIGHEST for action port [ 1132.049045] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-088d1fc5-dd9c-45fb-8610-49da8f0c493d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.049045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-088d1fc5-dd9c-45fb-8610-49da8f0c493d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.049045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-088d1fc5-dd9c-45fb-8610-49da8f0c493d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.049045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-088d1fc5-dd9c-45fb-8610-49da8f0c493d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.049045] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('088d1fc5-dd9c-45fb-8610-49da8f0c493d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.055041] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.055158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.146965] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1132.147216] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.462990] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1132.462990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.462990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.462990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.463257] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.463257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.463257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.463374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.463430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.463512] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.463602] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.555185] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 088d1fc5-dd9c-45fb-8610-49da8f0c493d [ 1132.555185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.555185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.555185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.555613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.555647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.555756] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:088d1fc5-dd9c-45fb-8610-49da8f0c493d already deleted. [ 1132.555811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-088d1fc5-dd9c-45fb-8610-49da8f0c493d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.965691] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.965843] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.965914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.966568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.966784] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.966984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.967052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.967225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.967320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.967431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.967621] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.969043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.969117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.969282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.969557] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.969609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.969673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.969833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.969934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.969996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.970096] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.473308] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4335c702-c854-428a-bca2-25e63a950287: rpc.has_security_group_logging(os_id): False [ 1133.519514] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.519712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.519712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.519875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.519959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.520283] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.520366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.520366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.520510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.520587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.520761] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.520853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.520913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.521063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.521136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.521311] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.521404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.521470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.521607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.521680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.521812] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1133.583018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.583432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.583432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.583501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.583620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.596929] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1133.981588] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1133.981885] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1133.982059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.324712] env[69358]: INFO networking_nsxv3.common.synchronization [None req-5c228587-b5dd-4073-906d-73f68aa49724 None None] Enqueued Resource ID: e36f12a5-cccb-48ec-b134-de2c7c400bc7 with Priority: HIGHEST for action port [ 1134.325411] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e36f12a5-cccb-48ec-b134-de2c7c400bc7 with Priority: HIGHEST for action port [ 1134.325836] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e36f12a5-cccb-48ec-b134-de2c7c400bc7 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.325996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e36f12a5-cccb-48ec-b134-de2c7c400bc7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.326078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e36f12a5-cccb-48ec-b134-de2c7c400bc7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.326472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e36f12a5-cccb-48ec-b134-de2c7c400bc7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.326472] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e36f12a5-cccb-48ec-b134-de2c7c400bc7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.828889] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e36f12a5-cccb-48ec-b134-de2c7c400bc7 [ 1134.829220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.829353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.829353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.829578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.829748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.829832] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e36f12a5-cccb-48ec-b134-de2c7c400bc7 already deleted. [ 1134.829864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e36f12a5-cccb-48ec-b134-de2c7c400bc7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.614261] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1135.614261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.614261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.614261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.614261] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.851042] env[69358]: INFO networking_nsxv3.common.synchronization [req-32fa98b5-d6d4-46d0-985a-c3c4f641d28c req-91842038-f2ff-4df9-8fd1-983ddf852051 tempest-ListImageFiltersTestJSON-1857961629 tempest-ListImageFiltersTestJSON-1857961629-project-member] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1135.851853] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGHEST for action security_group_members [ 1135.852454] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.852898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.853185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.853594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.855393] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.855393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.855393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.855393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.855393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.855393] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.942879] env[69358]: INFO networking_nsxv3.common.synchronization [req-e9d450c3-4783-4d9b-96c9-875027e4ca29 req-2299883b-ebd7-40ef-bd94-8eb9e49644f4 tempest-ServerDiskConfigTestJSON-623747719 tempest-ServerDiskConfigTestJSON-623747719-project-member] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1135.943243] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGHEST for action security_group_members [ 1135.943771] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.944053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.944053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.945459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.946376] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.946376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.946376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.946376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.946376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.946376] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.116211] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.116414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.116414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.116693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.116905] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.117049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.117143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.117374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.117511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.117612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.117707] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.357844] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.358065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.358140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.358362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.379780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.380036] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.380135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.380232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.380395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.380473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.380561] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb is going to be updated. [ 1136.403904] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.404138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.404138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.404341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.404620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.411965] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: IN_PROGRESS for 2s [ 1136.448736] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.448736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.448905] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.448985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.449104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.449301] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.449401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.449463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.449659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.449733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.449772] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be updated. [ 1136.486189] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.486328] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.486401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.486615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.486754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.496319] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: IN_PROGRESS for 2s [ 1136.620527] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.620954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.620954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.621068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.621168] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.621268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.621334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.621488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.621577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.621665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.621852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.621932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.621993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.622151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.622291] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.622385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.622442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.622577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.622652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.622733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.622821] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.125229] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4335c702-c854-428a-bca2-25e63a950287: rpc.has_security_group_logging(os_id): False [ 1137.142390] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.142570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.142570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.142815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.142927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.143205] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.143325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.143393] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.143582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.143686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.143892] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.143993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.144061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.144208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.144295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.144513] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.144657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.144657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.144824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.144901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.145015] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1137.217075] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.217229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.217337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.217568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.217710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.235061] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1138.420938] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb in Status: SUCCESS [ 1138.421229] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb deletion is rescheduled due to dependency. [ 1138.421277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.504541] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d904f37a-b3f7-4aef-9721-265081cb343b in Status: SUCCESS [ 1138.504717] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d904f37a-b3f7-4aef-9721-265081cb343b deletion is rescheduled due to dependency. [ 1138.504828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.252652] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1139.252958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.506568] env[69358]: INFO networking_nsxv3.common.synchronization [req-9457f0bb-7c4e-4ec7-bfb7-65b5e77765f9 req-015494e0-fffe-4bc7-b6ad-44801b50386d tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1139.507146] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1139.507552] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.507725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.507797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.508251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.508251] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.508401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.508401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.508505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.508729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.508852] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.798583] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.798720] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.798853] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.799163] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.799827] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.799998] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.800199] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.800437] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.800589] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.800808] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.800926] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.801049] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.801177] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.801300] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.801413] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.801552] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.820132] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.820332] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.820484] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.820671] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-921" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.821012] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-2379d709-639a-4d50-9631-aa9f0ca00619 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.821200] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-2379d709-639a-4d50-9631-aa9f0ca00619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.821327] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-2379d709-639a-4d50-9631-aa9f0ca00619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.821745] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-2379d709-639a-4d50-9631-aa9f0ca00619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.821898] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2379d709-639a-4d50-9631-aa9f0ca00619',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.014839] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.325069] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.325069] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.325362] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.325524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.325707] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.325894] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 2379d709-639a-4d50-9631-aa9f0ca00619 not found, creating... [ 1140.326225] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.326428] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.326567] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.326849] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.327052] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.327413] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.327602] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.327770] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.328022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.328206] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.328379] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 2379d709-639a-4d50-9631-aa9f0ca00619 is going to be created. [ 1140.346676] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.346873] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.347037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.347392] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.347658] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.347930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-2379d709-639a-4d50-9631-aa9f0ca00619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.470358] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.470490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.470568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.470765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.470873] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.517032] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.973436] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.019062] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.019265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.019265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.019505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.019600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.019700] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1141.044681] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.044818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.044890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.045111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.045299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.052460] env[69358]: INFO networking_nsxv3.common.synchronization [req-9457f0bb-7c4e-4ec7-bfb7-65b5e77765f9 req-9964c917-f24d-4bad-9ac1-018fab18ba59 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 1141.052681] env[69358]: INFO networking_nsxv3.common.synchronization [req-9457f0bb-7c4e-4ec7-bfb7-65b5e77765f9 req-9964c917-f24d-4bad-9ac1-018fab18ba59 service nova] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1141.052876] env[69358]: INFO networking_nsxv3.common.synchronization [req-9457f0bb-7c4e-4ec7-bfb7-65b5e77765f9 req-9964c917-f24d-4bad-9ac1-018fab18ba59 service nova] Enqueued Resource ID: 2379d709-639a-4d50-9631-aa9f0ca00619 with Priority: HIGHEST for action port [ 1141.054825] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1141.055239] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_rules [ 1141.055376] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1141.055978] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2379d709-639a-4d50-9631-aa9f0ca00619 with Priority: HIGHEST for action port [ 1141.055978] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.055978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.055978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.056190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.056190] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.057656] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.057774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.057984] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-2379d709-639a-4d50-9631-aa9f0ca00619 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.058271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2379d709-639a-4d50-9631-aa9f0ca00619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.058326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2379d709-639a-4d50-9631-aa9f0ca00619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.058478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2379d709-639a-4d50-9631-aa9f0ca00619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.059750] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2379d709-639a-4d50-9631-aa9f0ca00619',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.475443] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.558163] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.558504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.560910] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2379d709-639a-4d50-9631-aa9f0ca00619 with status ACTIVE [ 1141.561017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.561138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.561205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.561402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.561493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.561670] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.561799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.561839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.561970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.562057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.562232] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.562325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.562392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.562526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.562599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.562856] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2379d709-639a-4d50-9631-aa9f0ca00619 is going to be updated. [ 1141.586132] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.586267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.586345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.586547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.586683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.586846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2379d709-639a-4d50-9631-aa9f0ca00619" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.977523] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1141.977697] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1142.720502] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.720827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.720827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.720934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.732528] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1142.733474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.734614] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1142.766461] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.766621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.766687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.766892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.777797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.778460] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1142.778554] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1142.778642] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1142.814359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.814548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.814548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.814785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.815887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.816084] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1142.884745] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.884893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.884957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.885189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.885770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.886255] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1142.959130] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.959130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.959130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.959130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.959130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.959130] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1142.959130] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb', '1ab11f00-3987-4b05-b006-d9576475f847', '38b21152-b672-43d0-bb12-4ff761d0e3a8', '8effc622-7de8-42df-98f1-20eb9e446c1a', 'e45a41dd-b21d-4639-af89-ce7883a3d987', '689199c8-8cdd-4299-865b-276e93b23c6b', '5c2d1cb5-beda-4718-964c-8cbc07452049', '72792bb3-b78f-4b14-80d7-1253aec704ab', '6bcbfacc-e75b-4ac4-81ab-350530d27ada', 'f55e4213-4f47-44ae-b8e8-d46185e8161b', 'c5b54a11-30a4-4b59-9e2e-3429b26a65f9', 'f22bfa82-0766-4940-b70e-28b7b023248e', '012ec087-a6ab-4c42-83a0-58a518f9a415', '51af08cc-9a30-4dff-8fb1-ae75e324301c', '70627b51-3375-41aa-82f3-78ff340110c2', '20029fd2-1ece-44e8-95e9-efcf32b1a108', '7badac2d-7352-4331-adc3-4bc4f3b30231', 'a6825e81-3f64-4e7b-908b-47b35fcde1e2', 'd0705eac-ee26-4e23-89df-ec51465c3981', 'cf5ed3a6-0a90-4a9d-be28-a119103e9c61', '9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b', '92e0950b-cead-448f-83c8-f0567e5a19e2', '0c59601c-f6bf-486f-a60f-b19e02c39dbe', 'e0f3175f-70d6-4954-936f-524f7ca25a4b', 'a63445e5-d5fa-4b5f-aefd-36f6c4ad7252', '4335c702-c854-428a-bca2-25e63a950287', 'b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770', '4ea3bd4d-789d-41ef-b939-e3909d5d52e9', 'b8ab349f-7df0-40a9-a595-1a8e298f956a', '0e7da1ca-32ca-4463-86e0-e62b1a908a4a', '9495602c-f01c-4935-941b-dacd2d1ea667', '193bc791-0b82-49f5-a278-c6f34ab0eaf3', 'e9b439f6-daaf-4792-b3c7-d618e26ce5f4', 'd18a7451-b9c3-48be-82ef-e20729d3779a', 'd904f37a-b3f7-4aef-9721-265081cb343b', 'b2c85ab1-5f4b-4878-9858-c616793b3b32', '1426a21d-d3c6-4fed-bbe0-ee2b64373b73', '32d20126-9c39-42b2-acda-4aa519da54c6', 'a1e4e649-079d-4cd0-98f4-699005461275', '75c45f18-eee4-4639-b07a-413cc1624dbc', '46002bc2-9685-44d1-a0f5-f9a4ebc7e375', '98a5293d-e48e-493b-ac38-3a76cc74a5db', 'fd2c3b18-33a0-460a-a199-3124440c68e8', 'b755d42e-d250-4f75-9179-3ef054a079c6', 'ca6990b0-078a-4815-9003-99ea585a4222', '3c21f0b2-3055-4df5-9afa-fd29cf1279d5', '3790264b-87dd-4660-b7c5-8d4dc98f1500'} {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1142.959703] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1142.978469] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.978638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.978708] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.978889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.978979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.979104] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1142.979176] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1142.979247] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1143.048302] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.048528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.048601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.048823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.049899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.050178] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1143.050261] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1143.050335] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1143.050399] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1143.050477] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1143.050551] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGH for action security_group_rules [ 1143.050632] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGH for action security_group_rules [ 1143.050698] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGH for action security_group_rules [ 1143.050761] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGH for action security_group_rules [ 1143.050827] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGH for action security_group_rules [ 1143.050885] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGH for action security_group_rules [ 1143.050946] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGH for action security_group_rules [ 1143.051015] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGH for action security_group_rules [ 1143.051084] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGH for action security_group_rules [ 1143.051141] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGH for action security_group_rules [ 1143.051200] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGH for action security_group_rules [ 1143.051260] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGH for action security_group_rules [ 1143.051323] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGH for action security_group_rules [ 1143.051385] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGH for action security_group_rules [ 1143.051435] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGH for action security_group_rules [ 1143.051494] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGH for action security_group_rules [ 1143.051557] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGH for action security_group_rules [ 1143.051617] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGH for action security_group_rules [ 1143.051753] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGH for action security_group_rules [ 1143.051753] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGH for action security_group_rules [ 1143.051866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.063120] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1143.063346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.063529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.063762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.063946] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.064072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.064136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.064284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.064365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.064459] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.566631] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.070781] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.573064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.573235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.573286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.574669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.574669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.574669] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1144.601881] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.602214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.602214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.602402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.602976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.610232] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [req-5d57d9c9-bc8d-4560-b97e-8a8127232522 req-3b6f9898-db93-40df-91a1-cc008e1d232a tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0705eac-ee26-4e23-89df-ec51465c3981 with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 with Priority: HIGH for action security_group_rules [ 1146.051113] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGH for action security_group_rules [ 1146.053349] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22bfa82-0766-4940-b70e-28b7b023248e with Priority: HIGH for action security_group_rules [ 1146.053589] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGH for action security_group_rules [ 1146.053822] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4213-4f47-44ae-b8e8-d46185e8161b with Priority: HIGH for action security_group_rules [ 1146.054045] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGH for action security_group_rules [ 1146.054380] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689199c8-8cdd-4299-865b-276e93b23c6b with Priority: HIGH for action security_group_rules [ 1146.054594] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72792bb3-b78f-4b14-80d7-1253aec704ab with Priority: HIGH for action security_group_rules [ 1146.054911] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45a41dd-b21d-4639-af89-ce7883a3d987 with Priority: HIGH for action security_group_rules [ 1146.055166] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGH for action security_group_rules [ 1146.055572] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8effc622-7de8-42df-98f1-20eb9e446c1a with Priority: HIGH for action security_group_rules [ 1146.056057] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.056362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.056538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.058017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.058017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.058017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.058017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.058017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.058017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.058017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.059083] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.059326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.059497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.059759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.059958] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.062633] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38b21152-b672-43d0-bb12-4ff761d0e3a8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.063149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.064017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.064017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.064017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38b21152-b672-43d0-bb12-4ff761d0e3a8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.065195] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2d1cb5-beda-4718-964c-8cbc07452049 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.069639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.069639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.069639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.069639] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2d1cb5-beda-4718-964c-8cbc07452049',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.071131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.071131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.071131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.071131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.074041] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.074041] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.074041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.074041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.074041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.074041] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5ed3a6-0a90-4a9d-be28-a119103e9c61',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.074440] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0705eac-ee26-4e23-89df-ec51465c3981 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.075268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.075417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.075679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.075911] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0705eac-ee26-4e23-89df-ec51465c3981',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.078351] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.078351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.078351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.078351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.078351] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6825e81-3f64-4e7b-908b-47b35fcde1e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.078942] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7badac2d-7352-4331-adc3-4bc4f3b30231 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.079098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.079166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.079351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.079427] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7badac2d-7352-4331-adc3-4bc4f3b30231',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.080293] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.080453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.080500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.080662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.080694] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.082927] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20029fd2-1ece-44e8-95e9-efcf32b1a108 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.082927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.082927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.082927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.082927] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20029fd2-1ece-44e8-95e9-efcf32b1a108',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.083991] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.083991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.083991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.084180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.084218] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.085164] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f22bfa82-0766-4940-b70e-28b7b023248e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.085706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.085706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.085849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.085977] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f22bfa82-0766-4940-b70e-28b7b023248e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.086959] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.087415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.087550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.087783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.087908] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.089014] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55e4213-4f47-44ae-b8e8-d46185e8161b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.089145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.089197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.089329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.089397] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55e4213-4f47-44ae-b8e8-d46185e8161b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.090084] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.090188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.090294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.090459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.090580] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.091465] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-689199c8-8cdd-4299-865b-276e93b23c6b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.092637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.092637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.092637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.092637] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('689199c8-8cdd-4299-865b-276e93b23c6b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.093062] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72792bb3-b78f-4b14-80d7-1253aec704ab taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.093230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.093528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.093776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.093897] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72792bb3-b78f-4b14-80d7-1253aec704ab',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.094804] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45a41dd-b21d-4639-af89-ce7883a3d987 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.094954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.095267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.095313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.095400] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45a41dd-b21d-4639-af89-ce7883a3d987',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.096712] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.096712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.097041] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8effc622-7de8-42df-98f1-20eb9e446c1a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.097129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.097256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.097493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.097605] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8effc622-7de8-42df-98f1-20eb9e446c1a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.105636] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.105951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.106038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.106222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.106325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.106587] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.106676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.106727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.106864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.106949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.107073] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662b0a83-6546-43c9-93f7-23997583fecf already deleted. [ 1146.107193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.124705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.124929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.125065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.125327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.144808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.144957] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 689199c8-8cdd-4299-865b-276e93b23c6b is going to be deleted. [ 1146.202826] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.203078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.203347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.203601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.203696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.203799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-689199c8-8cdd-4299-865b-276e93b23c6b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.345053] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.345342] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.345490] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.345823] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.346163] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.346375] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.346529] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.346798] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.347017] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.347297] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.347440] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.347594] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.347713] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.347850] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.348009] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.348188] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.392760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.393021] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1146.393106] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.393299] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.393761] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a254bc29-9530-4d10-8122-ae764a8fcd27 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.393961] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a254bc29-9530-4d10-8122-ae764a8fcd27" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.394100] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a254bc29-9530-4d10-8122-ae764a8fcd27" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.394424] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a254bc29-9530-4d10-8122-ae764a8fcd27" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.394567] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a254bc29-9530-4d10-8122-ae764a8fcd27',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.601608] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.601798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.601798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.601970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.602177] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.602294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.602355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.602516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.602618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.602705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.602809] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.604715] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.604830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.604886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.605068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.605278] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.605365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.605428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.605654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.605654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.605758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.605848] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.621584] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.621761] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.621822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.623023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.623023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.623023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.623023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.623023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.623023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.623023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.623023] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.670066] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.670066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.670066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.670066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.671706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.672180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.672624] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.672737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.673701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.673839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.674457] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.674565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.675269] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.675377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.676179] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.676179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.677063] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.677063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.677716] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.677802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.678592] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.678692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.679417] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.679515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.680092] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1146.680521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.680626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.681223] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1146.681560] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1146.681777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.682371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.682672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.682903] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.683047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.683147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.683360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.683451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.683539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.683631] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.685021] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1146.685417] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.685521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.686381] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1146.686614] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.686738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.687354] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1146.687915] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.688545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.689122] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1146.689520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.689630] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6825e81-3f64-4e7b-908b-47b35fcde1e2 is going to be deleted. [ 1146.690496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.690687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.705930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.706091] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20029fd2-1ece-44e8-95e9-efcf32b1a108 is going to be deleted. [ 1146.707605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.707848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.725896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.726085] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be deleted. [ 1146.727052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.727377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.744052] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.744239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.755287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.755287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.755287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.755287] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2d1cb5-beda-4718-964c-8cbc07452049 is going to be deleted. [ 1146.756189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.756408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.776022] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.776171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.777093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.777275] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38b21152-b672-43d0-bb12-4ff761d0e3a8 is going to be deleted. [ 1146.778378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.778592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.796267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.796628] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0705eac-ee26-4e23-89df-ec51465c3981 is going to be deleted. [ 1146.797945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.798222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.841471] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.841694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.842496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.842605] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55e4213-4f47-44ae-b8e8-d46185e8161b is going to be deleted. [ 1146.843660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.843881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.889793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.889793] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5ed3a6-0a90-4a9d-be28-a119103e9c61 is going to be deleted. [ 1146.890746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.891018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.893862] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.893981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.897521] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.897521] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.897521] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.897521] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.897521] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.897776] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a254bc29-9530-4d10-8122-ae764a8fcd27 not found, creating... [ 1146.897886] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.898015] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.898181] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.898424] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.898574] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.898861] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.899032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.899158] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.899369] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.899508] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.899653] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a254bc29-9530-4d10-8122-ae764a8fcd27 is going to be created. [ 1146.929262] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.929475] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.944308] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.944540] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.944681] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.944982] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.945238] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.945470] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a254bc29-9530-4d10-8122-ae764a8fcd27" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.949804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.949804] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f22bfa82-0766-4940-b70e-28b7b023248e is going to be deleted. [ 1146.950815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.951244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.971971] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.972103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.042796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.042796] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7badac2d-7352-4331-adc3-4bc4f3b30231 is going to be deleted. [ 1147.042796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.042796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.053458] env[69358]: INFO networking_nsxv3.common.synchronization [req-8b8f215c-097a-438a-a7c8-6ea55ae742c5 req-e7173a5e-7944-4a47-b09a-9ce68ea2baca tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1147.053458] env[69358]: INFO networking_nsxv3.common.synchronization [req-8b8f215c-097a-438a-a7c8-6ea55ae742c5 req-e7173a5e-7944-4a47-b09a-9ce68ea2baca tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGHEST for action security_group_members [ 1147.053796] env[69358]: INFO networking_nsxv3.common.synchronization [req-8b8f215c-097a-438a-a7c8-6ea55ae742c5 req-e7173a5e-7944-4a47-b09a-9ce68ea2baca tempest-SecurityGroupsTestJSON-814864687 tempest-SecurityGroupsTestJSON-814864687-project-member] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1147.054099] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGHEST for action security_group_members [ 1147.054234] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGHEST for action security_group_members [ 1147.054329] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGHEST for action security_group_members [ 1147.054602] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.054723] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.054787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.054977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.055296] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.055414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.055472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.055639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.055717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.055808] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.060238] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c45f18-eee4-4639-b07a-413cc1624dbc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.060370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.060473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.060713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.060878] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.060980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.061057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.061211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.061296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.061389] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.062257] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.062368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.062434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.062585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.062765] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.062864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.062926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.063080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.063160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.063245] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.090167] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.090360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.095518] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.095651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.106060] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.115506] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.130593] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.132819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.133061] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be deleted. [ 1147.134589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.134941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.184217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.184367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45a41dd-b21d-4639-af89-ce7883a3d987 is going to be deleted. [ 1147.185674] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.185878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.189434] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.189593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.189655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.189830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.189993] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.190121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.190184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.190332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.190430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.190519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.190681] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.190775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.190834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.190972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.191149] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.191252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.191343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.191490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.191574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.191660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.191762] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.193217] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.193336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.257966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.258134] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb is going to be deleted. [ 1147.259032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.259238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.314442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.314604] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8effc622-7de8-42df-98f1-20eb9e446c1a is going to be deleted. [ 1147.315638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.316161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.361990] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.362132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.366338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.366594] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72792bb3-b78f-4b14-80d7-1253aec704ab is going to be deleted. [ 1147.367594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.367800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.367890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.368027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6825e81-3f64-4e7b-908b-47b35fcde1e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.368752] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.368856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.368932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.369118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.369208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.369332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.369471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.369628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.369710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.369839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20029fd2-1ece-44e8-95e9-efcf32b1a108" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.370308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.370466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.370548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.370660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.370806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.371000] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.371097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.371211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2d1cb5-beda-4718-964c-8cbc07452049" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.371323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.371486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.371584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.371701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38b21152-b672-43d0-bb12-4ff761d0e3a8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.371824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.371962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.372047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.372156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0705eac-ee26-4e23-89df-ec51465c3981" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.372263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.372397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.372467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.372570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55e4213-4f47-44ae-b8e8-d46185e8161b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.372691] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.372826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.372899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.373015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f22bfa82-0766-4940-b70e-28b7b023248e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.373141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.373305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.373382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.373489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5ed3a6-0a90-4a9d-be28-a119103e9c61" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.373613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.373750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.373822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.373919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7badac2d-7352-4331-adc3-4bc4f3b30231" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.374036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.374172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.374244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.374344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45a41dd-b21d-4639-af89-ce7883a3d987" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.389825] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.389954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.390037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.390206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.390316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.390433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d1cfa05-1d8a-4252-9e78-7b1c7aae24fb" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.423103] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.423250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.423320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.423549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.423603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.423717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8effc622-7de8-42df-98f1-20eb9e446c1a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.443194] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.443357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.443555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.443644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.443758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72792bb3-b78f-4b14-80d7-1253aec704ab" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.557794] env[69358]: INFO networking_nsxv3.common.synchronization [req-5d57d9c9-bc8d-4560-b97e-8a8127232522 req-cd7eeb59-d0f1-426b-ba94-5f55e04311d4 service nova] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_rules [ 1147.558014] env[69358]: INFO networking_nsxv3.common.synchronization [req-5d57d9c9-bc8d-4560-b97e-8a8127232522 req-cd7eeb59-d0f1-426b-ba94-5f55e04311d4 service nova] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1147.558174] env[69358]: INFO networking_nsxv3.common.synchronization [req-5d57d9c9-bc8d-4560-b97e-8a8127232522 req-cd7eeb59-d0f1-426b-ba94-5f55e04311d4 service nova] Enqueued Resource ID: a254bc29-9530-4d10-8122-ae764a8fcd27 with Priority: HIGHEST for action port [ 1147.558978] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_rules [ 1147.558978] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1147.558978] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a254bc29-9530-4d10-8122-ae764a8fcd27 with Priority: HIGHEST for action port [ 1147.559291] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.559397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.559460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.559705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.559799] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.560685] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.561789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.561789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.561789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.561789] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.561789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.561789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.561789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.561789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.561789] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.562367] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a254bc29-9530-4d10-8122-ae764a8fcd27 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.563192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a254bc29-9530-4d10-8122-ae764a8fcd27" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.563192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a254bc29-9530-4d10-8122-ae764a8fcd27" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.563192] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a254bc29-9530-4d10-8122-ae764a8fcd27" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.563192] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a254bc29-9530-4d10-8122-ae764a8fcd27',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.564516] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.565335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.565335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.565335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.565855] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.566409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.566409] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.566409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.602376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.602666] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.602799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.602847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.603069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.603174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.603485] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c45f18-eee4-4639-b07a-413cc1624dbc is going to be updated. [ 1147.604332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.604578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.607280] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6bcbfacc-e75b-4ac4-81ab-350530d27ada: rpc.has_security_group_logging(os_id): False [ 1147.617152] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70627b51-3375-41aa-82f3-78ff340110c2: rpc.has_security_group_logging(os_id): False [ 1147.630155] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.630255] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.632684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.632831] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.632947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.633106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.633247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.633372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.633413] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be updated. [ 1147.634321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.634493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.635598] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5b54a11-30a4-4b59-9e2e-3429b26a65f9: rpc.has_security_group_logging(os_id): False [ 1147.652056] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.652223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.655450] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.655450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.661654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.661900] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.662028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.662100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.662309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.662407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.662503] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be updated. [ 1147.663450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.663620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.665260] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.665387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.665387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.665548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.665678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.673178] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c45f18-eee4-4639-b07a-413cc1624dbc in Status: IN_PROGRESS for 2s [ 1147.687286] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.687489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.687600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.687834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.687973] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.689752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.690030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.690126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.690191] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.690361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.690442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.690534] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada is going to be updated. [ 1147.692160] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.692274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.692343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.692501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.692641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.693752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.693913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.695474] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 1147.706482] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: IN_PROGRESS for 2s [ 1147.707136] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: IN_PROGRESS for 2s [ 1147.712010] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.712137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.715384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.715672] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.715825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.715825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.716016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.716108] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.716199] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1147.717252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.717443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.717530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.717734] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.717824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.717876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.718037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.718117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.718198] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be updated. [ 1147.719048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.719211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.740760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.741023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.741143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.741257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.741416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.741504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.741696] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.741797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.741859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.742010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.742091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.742285] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.742379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.742466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.742609] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.742683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.742760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1147.749779] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.749896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.749939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.750127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.750364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.852199] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: IN_PROGRESS for 2s [ 1147.881099] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.881237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.881305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.881544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.881676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.883431] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.884062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.884062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.884062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.884062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.912767] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1147.916960] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: IN_PROGRESS for 2s [ 1147.948465] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.948655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.948731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.948963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.949122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.979574] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1148.064668] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.064944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.065156] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.070027] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a254bc29-9530-4d10-8122-ae764a8fcd27 with status ACTIVE [ 1148.070027] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.070027] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.070027] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.070027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.070027] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a254bc29-9530-4d10-8122-ae764a8fcd27 is going to be updated. [ 1148.093512] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.093676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.093749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.093962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.094113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.094272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a254bc29-9530-4d10-8122-ae764a8fcd27" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.573094] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.575246] env[69358]: INFO networking_nsxv3.common.synchronization [None req-d0f825dd-4119-44d5-b590-b677b2526769 tempest-AttachVolumeTestJSON-45129221 tempest-AttachVolumeTestJSON-45129221-project-member] Enqueued Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_rules [ 1148.575989] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_rules [ 1148.576353] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b753fa61-5f01-4b27-9adf-adec33a7b29e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.576492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.576563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.576817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.576896] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.671498] env[69358]: INFO networking_nsxv3.common.synchronization [None req-07f48c27-842e-4ee7-8c9f-dc0c9a89ea15 tempest-AttachVolumeTestJSON-45129221 tempest-AttachVolumeTestJSON-45129221-project-member] Enqueued Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_rules [ 1148.672073] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_rules [ 1148.672390] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b753fa61-5f01-4b27-9adf-adec33a7b29e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.672495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.076494] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.076789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.076789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.077046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.077175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.077370] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662b0a83-6546-43c9-93f7-23997583fecf is going to be created. [ 1149.094388] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.094549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.094614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.094816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.094926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.095039] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b753fa61-5f01-4b27-9adf-adec33a7b29e already deleted. [ 1149.095153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.095334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.095496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.095582] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.101872] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.101995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.102077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.102247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.102382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.110711] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: UNINITIALIZED for 2s [ 1149.615879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.615879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.615879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.616218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.616218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.616218] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b753fa61-5f01-4b27-9adf-adec33a7b29e already deleted. [ 1149.616339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.683078] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c45f18-eee4-4639-b07a-413cc1624dbc in Status: SUCCESS [ 1149.683078] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c45f18-eee4-4639-b07a-413cc1624dbc deletion is rescheduled due to dependency. [ 1149.683078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.718185] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4335c702-c854-428a-bca2-25e63a950287 in Status: SUCCESS [ 1149.718398] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4335c702-c854-428a-bca2-25e63a950287 deletion is rescheduled due to dependency. [ 1149.718557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.719477] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: SUCCESS [ 1149.719686] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 deletion is rescheduled due to dependency. [ 1149.719819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.867319] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: SUCCESS [ 1149.867651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.930278] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1149.930523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.931344] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 in Status: SUCCESS [ 1149.931522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.998113] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1149.998397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.998615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.998843] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.998933] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.504018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.504330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.504330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.504473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.504678] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.504811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.504811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.504956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.505074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.505163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.505250] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.015244] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.015410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.015451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.015675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.015838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.015935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.015999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.016158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.016248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.016338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.016489] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.016581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.016640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.016779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.016935] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.016996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.017068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.017237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.017304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.017377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.017468] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.120640] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: SUCCESS [ 1151.120640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.120640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.120640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.120815] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.120928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.120999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.121157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.121232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.121321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.121411] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.520060] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab11f00-3987-4b05-b006-d9576475f847: rpc.has_security_group_logging(os_id): False [ 1151.541170] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.541321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.541394] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.541598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.541687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.541881] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.541977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.542049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.542194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.542268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.542453] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.542545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.542606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.542743] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.542826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.543040] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.543133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.543193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.543329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.543403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.543487] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1151.615702] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.615859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.615932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.616166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.616322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.622988] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.629089] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1152.125551] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 662b0a83-6546-43c9-93f7-23997583fecf: rpc.has_security_group_logging(os_id): False [ 1152.142679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.142860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.142930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.143153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.143261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.143515] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.143628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.143786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.143876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.143972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.144553] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 662b0a83-6546-43c9-93f7-23997583fecf is going to be created. [ 1152.167681] env[69358]: INFO networking_nsxv3.common.synchronization [req-31236ddc-4ccd-4e34-9cea-62b60bc98c95 req-2a629efb-705b-426e-b8c6-33372260c818 tempest-ServerTagsTestJSON-339796703 tempest-ServerTagsTestJSON-339796703-project-member] Enqueued Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGHEST for action security_group_members [ 1152.168864] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGHEST for action security_group_members [ 1152.168864] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b12b9f-791a-4b1b-a31c-2e597d81d82d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.168864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.168864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.169195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.169368] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.169490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.169644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.169754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.169889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.170027] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.205953] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.206247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.206315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.206556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.206789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.217790] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: IN_PROGRESS for 2s [ 1152.485601] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.485815] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-188" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.485945] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-188" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.486308] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-188" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.486574] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.486735] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.486856] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.487225] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.487501] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.487808] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.487993] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.488173] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.488335] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.488502] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.488657] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.488837] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.506978] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.507160] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1152.507370] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.507548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-188" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.507964] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-a8408222-8d47-4f06-875f-fd7d2ae6fd77 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.508049] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-a8408222-8d47-4f06-875f-fd7d2ae6fd77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.508145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-a8408222-8d47-4f06-875f-fd7d2ae6fd77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.508494] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-a8408222-8d47-4f06-875f-fd7d2ae6fd77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.508590] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8408222-8d47-4f06-875f-fd7d2ae6fd77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.672975] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.673248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.673248] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.673465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.673532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.673709] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.673808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.673859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.674015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.674098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.674184] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d already deleted. [ 1152.674263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.013219] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.013219] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.013397] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.013775] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.013931] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.014196] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port a8408222-8d47-4f06-875f-fd7d2ae6fd77 not found, creating... [ 1153.014567] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.014794] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.015011] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.015670] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.015670] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.016154] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.016154] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.016269] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.016581] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.016823] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.017167] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: a8408222-8d47-4f06-875f-fd7d2ae6fd77 is going to be created. [ 1153.038046] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.038046] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.038046] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.038046] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.038046] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.038046] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-a8408222-8d47-4f06-875f-fd7d2ae6fd77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.643595] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1153.643835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.768276] env[69358]: INFO networking_nsxv3.common.synchronization [req-31236ddc-4ccd-4e34-9cea-62b60bc98c95 req-02817346-7445-424c-a051-9d032ba68bd7 service nova] Enqueued Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGHEST for action security_group_rules [ 1153.768527] env[69358]: INFO networking_nsxv3.common.synchronization [req-31236ddc-4ccd-4e34-9cea-62b60bc98c95 req-02817346-7445-424c-a051-9d032ba68bd7 service nova] Enqueued Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGHEST for action security_group_members [ 1153.768567] env[69358]: INFO networking_nsxv3.common.synchronization [req-31236ddc-4ccd-4e34-9cea-62b60bc98c95 req-02817346-7445-424c-a051-9d032ba68bd7 service nova] Enqueued Resource ID: a8408222-8d47-4f06-875f-fd7d2ae6fd77 with Priority: HIGHEST for action port [ 1153.768787] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGHEST for action security_group_rules [ 1153.768908] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGHEST for action security_group_members [ 1153.769009] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8408222-8d47-4f06-875f-fd7d2ae6fd77 with Priority: HIGHEST for action port [ 1153.773305] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.773428] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.773499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.773745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.773828] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.775144] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b12b9f-791a-4b1b-a31c-2e597d81d82d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.775288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.775363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.775529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.775706] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.775765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.775831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.775971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.776070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.776158] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.777242] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8408222-8d47-4f06-875f-fd7d2ae6fd77 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.777335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8408222-8d47-4f06-875f-fd7d2ae6fd77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.777378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8408222-8d47-4f06-875f-fd7d2ae6fd77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.777612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8408222-8d47-4f06-875f-fd7d2ae6fd77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.777612] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8408222-8d47-4f06-875f-fd7d2ae6fd77',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.228420] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: SUCCESS [ 1154.228590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.279038] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.280183] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b12b9f-791a-4b1b-a31c-2e597d81d82d taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.280299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.280462] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8408222-8d47-4f06-875f-fd7d2ae6fd77 with status ACTIVE [ 1154.280622] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.280728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.280790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.280988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.281090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.281386] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.281519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.281579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.281737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.281815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.281995] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.282098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.282153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.282288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.282361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.282442] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8408222-8d47-4f06-875f-fd7d2ae6fd77 is going to be updated. [ 1154.300227] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.300391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.300391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.300574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.300697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.300845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8408222-8d47-4f06-875f-fd7d2ae6fd77" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.784094] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.287268] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.287452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.290013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.290013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.290013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.290013] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d is going to be created. [ 1155.299936] env[69358]: INFO networking_nsxv3.common.synchronization [req-b10997c2-d62f-464e-a601-7ac4ebf1e1f3 req-4a20a36b-ead8-4a2c-89f0-c1346bd51113 tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1155.299936] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1155.300271] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.300417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.300484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.300678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.300827] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.300932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.301022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.301175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.301259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.301353] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.310112] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.310112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.310112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.310312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.310312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.320583] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d in Status: UNINITIALIZED for 2s [ 1155.804271] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.306755] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.813257] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.813587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.813587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.813775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.813869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.814021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1156.838388] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.838576] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.838650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.838856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.839110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.849807] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1157.330725] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d in Status: SUCCESS [ 1157.331777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.332181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.332181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.332390] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.332702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.332807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.333062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.333187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.333325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.333462] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.837596] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b12b9f-791a-4b1b-a31c-2e597d81d82d taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.837956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.837956] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.838136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.838214] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.838312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.838377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.838523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.838908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.838908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.838908] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b12b9f-791a-4b1b-a31c-2e597d81d82d taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.838908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.839101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.839101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.839920] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.839920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.839920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.839920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.839920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.839920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.839920] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.347222] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32b12b9f-791a-4b1b-a31c-2e597d81d82d: rpc.has_security_group_logging(os_id): False [ 1158.368629] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.369405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.369405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.369405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.369599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.369785] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.369785] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.369934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.370072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.370174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.370366] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.370545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.370545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.371886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.372756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.372756] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.372756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.372756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.372931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.372931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.372998] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d is going to be created. [ 1158.425370] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.426545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.426545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.426545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.426545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.437899] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d in Status: IN_PROGRESS for 2s [ 1158.859140] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1158.859543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.301036] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1160.301036] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1160.450513] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d in Status: SUCCESS [ 1160.450738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.442689] env[69358]: INFO networking_nsxv3.common.synchronization [req-3cb2610b-7ae9-420a-965e-a7059638f0a0 req-3539e1b1-9247-40dd-a81a-f376ec7a5dcf tempest-AttachVolumeTestJSON-45129221 tempest-AttachVolumeTestJSON-45129221-project-member] Enqueued Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_members [ 1162.443266] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_members [ 1162.443621] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b753fa61-5f01-4b27-9adf-adec33a7b29e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.443777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.443850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.444119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.444282] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.444364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.444425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.444570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.444675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.444729] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.765949] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.766179] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-634" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.766308] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-634" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.766588] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-634" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.766853] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.767015] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.767139] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.767443] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.767605] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.767821] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1162.767940] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.768065] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.768200] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.768336] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1162.768443] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.768579] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.789012] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.789012] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1162.789012] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.789012] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-634" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.789012] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-99f73ccf-9fc0-4f75-b176-6a0393f6306a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.789362] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-99f73ccf-9fc0-4f75-b176-6a0393f6306a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.789362] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-99f73ccf-9fc0-4f75-b176-6a0393f6306a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.789737] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-99f73ccf-9fc0-4f75-b176-6a0393f6306a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.789884] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f73ccf-9fc0-4f75-b176-6a0393f6306a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.946838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.946838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.946838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.947076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.947076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.947208] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.947305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.947369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.947520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.947599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.947683] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b753fa61-5f01-4b27-9adf-adec33a7b29e already deleted. [ 1162.947762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.292312] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.292539] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.292671] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.293070] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.293231] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.293389] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 99f73ccf-9fc0-4f75-b176-6a0393f6306a not found, creating... [ 1163.294022] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.294022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.294022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.294203] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.294390] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.294734] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.294932] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.295235] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.295472] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.295618] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.295768] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 99f73ccf-9fc0-4f75-b176-6a0393f6306a is going to be created. [ 1163.314579] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.314579] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.314719] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.314906] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.315161] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.315395] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-99f73ccf-9fc0-4f75-b176-6a0393f6306a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.310020] env[69358]: INFO networking_nsxv3.common.synchronization [req-3cb2610b-7ae9-420a-965e-a7059638f0a0 req-33653a0f-05f4-4346-85b9-29233fbf2922 service nova] Enqueued Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_rules [ 1164.310020] env[69358]: INFO networking_nsxv3.common.synchronization [req-3cb2610b-7ae9-420a-965e-a7059638f0a0 req-33653a0f-05f4-4346-85b9-29233fbf2922 service nova] Enqueued Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_members [ 1164.310020] env[69358]: INFO networking_nsxv3.common.synchronization [req-3cb2610b-7ae9-420a-965e-a7059638f0a0 req-33653a0f-05f4-4346-85b9-29233fbf2922 service nova] Enqueued Resource ID: 99f73ccf-9fc0-4f75-b176-6a0393f6306a with Priority: HIGHEST for action port [ 1164.310020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_rules [ 1164.310020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_members [ 1164.310020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99f73ccf-9fc0-4f75-b176-6a0393f6306a with Priority: HIGHEST for action port [ 1164.310020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b753fa61-5f01-4b27-9adf-adec33a7b29e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.310020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.310020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.310020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.310020] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.311126] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b753fa61-5f01-4b27-9adf-adec33a7b29e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.311126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.311126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.311304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.311455] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.311551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.311681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.311788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.311830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.311920] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.313218] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-99f73ccf-9fc0-4f75-b176-6a0393f6306a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.313338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99f73ccf-9fc0-4f75-b176-6a0393f6306a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.313381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99f73ccf-9fc0-4f75-b176-6a0393f6306a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.313531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99f73ccf-9fc0-4f75-b176-6a0393f6306a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.313600] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f73ccf-9fc0-4f75-b176-6a0393f6306a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.813817] env[69358]: INFO networking_nsxv3.common.synchronization [req-b9e2ca8c-e061-4df6-8992-f0eee4e493ed req-890819ad-e48e-4ecd-bafa-dee5d2434cc6 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1164.814067] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.815338] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1164.815465] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99f73ccf-9fc0-4f75-b176-6a0393f6306a with status ACTIVE [ 1164.815631] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.815798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.815876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.816089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.816193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.816400] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.816862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.816862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.816862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.816862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.817147] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.817210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.817287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.817728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.817728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.817728] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99f73ccf-9fc0-4f75-b176-6a0393f6306a is going to be updated. [ 1164.818869] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b753fa61-5f01-4b27-9adf-adec33a7b29e taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.819008] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.822588] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.822845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.822845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.823171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.823241] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.823367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.823471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.823652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.823751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.823912] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.851573] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.851795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.851795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.851997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.852147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.852306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99f73ccf-9fc0-4f75-b176-6a0393f6306a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.150127] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.150344] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.150473] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.150747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.151406] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.151604] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.151732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.151972] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.152138] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.152357] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.152491] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.152585] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.152701] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.152812] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.152923] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.153069] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.174302] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.174497] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.174620] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.174803] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.175264] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-72e94a33-af09-45e9-9f37-7a04adbbd1ea taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.175512] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-72e94a33-af09-45e9-9f37-7a04adbbd1ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.175723] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-72e94a33-af09-45e9-9f37-7a04adbbd1ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.176085] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-72e94a33-af09-45e9-9f37-7a04adbbd1ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.176238] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72e94a33-af09-45e9-9f37-7a04adbbd1ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.325772] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.329169] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.329370] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.329471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.329925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.351179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.351342] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.351855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.351855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.351855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.351855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.352094] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1165.374806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.374983] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.375099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.375411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.375628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.384014] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1165.679363] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.679624] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.679784] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.680089] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.680322] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.680499] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 72e94a33-af09-45e9-9f37-7a04adbbd1ea not found, creating... [ 1165.680771] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.680931] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.681065] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.681329] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.681485] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.681774] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.681935] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.682070] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.682298] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.682429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.682597] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 72e94a33-af09-45e9-9f37-7a04adbbd1ea is going to be created. [ 1165.700872] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.701104] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.701241] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.701566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.701815] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.702069] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-72e94a33-af09-45e9-9f37-7a04adbbd1ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.829166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.829348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.829348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.829693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.829817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.829941] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b753fa61-5f01-4b27-9adf-adec33a7b29e is going to be created. [ 1165.857124] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.857410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.857525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.857828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.858084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.870460] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b753fa61-5f01-4b27-9adf-adec33a7b29e in Status: UNINITIALIZED for 2s [ 1166.639845] env[69358]: INFO networking_nsxv3.common.synchronization [req-b9e2ca8c-e061-4df6-8992-f0eee4e493ed req-91b29051-9767-43e7-b5f8-3219c7f4d0d1 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1166.640188] env[69358]: INFO networking_nsxv3.common.synchronization [req-b9e2ca8c-e061-4df6-8992-f0eee4e493ed req-91b29051-9767-43e7-b5f8-3219c7f4d0d1 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1166.640397] env[69358]: INFO networking_nsxv3.common.synchronization [req-b9e2ca8c-e061-4df6-8992-f0eee4e493ed req-91b29051-9767-43e7-b5f8-3219c7f4d0d1 service nova] Enqueued Resource ID: 72e94a33-af09-45e9-9f37-7a04adbbd1ea with Priority: HIGHEST for action port [ 1166.640537] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1166.640673] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1166.640772] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72e94a33-af09-45e9-9f37-7a04adbbd1ea with Priority: HIGHEST for action port [ 1166.641507] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.641691] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.641775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.642028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.642120] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.643009] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.643143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.643405] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-72e94a33-af09-45e9-9f37-7a04adbbd1ea taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.643545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72e94a33-af09-45e9-9f37-7a04adbbd1ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.643610] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72e94a33-af09-45e9-9f37-7a04adbbd1ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.643787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72e94a33-af09-45e9-9f37-7a04adbbd1ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.643863] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72e94a33-af09-45e9-9f37-7a04adbbd1ea',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.145547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.145684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.149104] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72e94a33-af09-45e9-9f37-7a04adbbd1ea with status ACTIVE [ 1167.149301] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.149431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.149493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.149726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.149817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.149993] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.150111] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.150179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.150324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.150377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.150565] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.150653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.150703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.150824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.150977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.150977] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72e94a33-af09-45e9-9f37-7a04adbbd1ea is going to be updated. [ 1167.173068] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.173068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.173068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.173293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.173399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.173562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72e94a33-af09-45e9-9f37-7a04adbbd1ea" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.396620] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1167.396813] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1167.396952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.397224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.397486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.397709] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.397850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.397929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.398147] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.398300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.398406] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.582019] env[69358]: INFO networking_nsxv3.common.synchronization [req-09f78aec-18d3-4845-8762-d75acc57e73c req-ae0d78dc-b9b2-4416-a3e5-20faac588063 tempest-ServerTagsTestJSON-339796703 tempest-ServerTagsTestJSON-339796703-project-member] Enqueued Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGHEST for action security_group_members [ 1167.582669] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGHEST for action security_group_members [ 1167.583057] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b12b9f-791a-4b1b-a31c-2e597d81d82d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.583199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.583287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.583583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.583844] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.583912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.584016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.584538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.584651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.584861] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.880080] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b753fa61-5f01-4b27-9adf-adec33a7b29e in Status: SUCCESS [ 1167.880356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.880486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.880651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.880836] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.880954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.881028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.881179] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.881260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.881347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.881441] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.901151] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.088162] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.088418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.089041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.089041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.089041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.089202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.089330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.089408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.089740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.089740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.089924] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d is going to be updated. [ 1168.122394] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.122522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.122522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.122789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.122933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.131145] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d in Status: IN_PROGRESS for 2s [ 1168.383234] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.403124] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.866434] env[69358]: INFO networking_nsxv3.common.synchronization [req-52de95d5-209e-4ba9-a096-21a13c56b3bc req-042ae186-4ff2-46a0-b66f-b1885b91631f tempest-AttachVolumeShelveTestJSON-2021849226 tempest-AttachVolumeShelveTestJSON-2021849226-project-member] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_members [ 1168.866996] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGHEST for action security_group_members [ 1168.867304] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.867425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.867488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.867671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.868217] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.868217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.868217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.868217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.868217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.868410] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.885372] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b753fa61-5f01-4b27-9adf-adec33a7b29e: rpc.has_security_group_logging(os_id): False [ 1168.902455] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.902621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.902621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.902814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.902898] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.903184] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.903289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.903348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.903486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.903558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.903642] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b753fa61-5f01-4b27-9adf-adec33a7b29e is going to be created. [ 1168.904781] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.904963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.904963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.905314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.905314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.905314] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1168.930226] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.930373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.930419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.930614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.930752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.938557] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1168.971989] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.972154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.972205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.972410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.972583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.982306] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b753fa61-5f01-4b27-9adf-adec33a7b29e in Status: IN_PROGRESS for 2s [ 1169.371076] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.371586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.371782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.372123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.372347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.372668] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.372909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.373124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.373418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.373615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.373810] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada is going to be updated. [ 1169.399050] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.399050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.399050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.399487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.399649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.407358] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: IN_PROGRESS for 2s [ 1169.878267] env[69358]: INFO networking_nsxv3.common.synchronization [req-49ce4591-ea9f-4f0b-97b3-db3c993b426b req-00d0ca04-7a86-4b9b-9b98-8860a0a51f8f tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1169.879606] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1169.880115] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.880221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.880274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.880468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.880677] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.880745] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.880793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.880937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.881040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.881258] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.140530] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d in Status: SUCCESS [ 1170.140830] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d deletion is rescheduled due to dependency. [ 1170.140830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.232223] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.232435] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.232566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.232842] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.233117] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.233282] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.233408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.233628] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.233779] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.233994] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.234139] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.234258] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.234373] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.234491] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.234605] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.234745] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.254831] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.255082] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1170.255296] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.255533] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.255939] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-64987207-ee0c-4531-bf02-3e8bc96c70d3 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.256188] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-64987207-ee0c-4531-bf02-3e8bc96c70d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.256361] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-64987207-ee0c-4531-bf02-3e8bc96c70d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.256749] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-64987207-ee0c-4531-bf02-3e8bc96c70d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.256947] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64987207-ee0c-4531-bf02-3e8bc96c70d3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.384255] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.591502] env[69358]: INFO networking_nsxv3.common.synchronization [req-e1963a77-542a-4719-ad24-25956a7a0086 req-27ab4c50-b9ac-425e-ab0d-89de9580fe0c tempest-ServersTestJSON-1404469400 tempest-ServersTestJSON-1404469400-project-member] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1170.592453] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGHEST for action security_group_members [ 1170.593205] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.593479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.593577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.593833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.594196] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.594640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.594640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.594738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.594837] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.594999] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.759464] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.759755] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.759868] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.760485] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.760621] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.760836] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 64987207-ee0c-4531-bf02-3e8bc96c70d3 not found, creating... [ 1170.761240] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.761465] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.761648] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.762057] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.762279] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.762721] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.763011] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.763240] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.763569] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.763779] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.764047] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 64987207-ee0c-4531-bf02-3e8bc96c70d3 is going to be created. [ 1170.784848] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.785131] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.785409] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.785721] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.785961] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.786240] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-64987207-ee0c-4531-bf02-3e8bc96c70d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.886699] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.952797] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1170.953041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.953231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.953510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.953678] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.953854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.953930] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.954045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.954132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.954261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.954360] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.998049] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b753fa61-5f01-4b27-9adf-adec33a7b29e in Status: SUCCESS [ 1170.998316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.096977] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.097162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.097240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.097456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.097550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.097855] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.097855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.097978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.098050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.098146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.098233] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be updated. [ 1171.122591] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.122670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.122748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.122984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.123563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.132426] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: IN_PROGRESS for 2s [ 1171.389964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.390307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.390307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.390443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.390474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.390573] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662b0a83-6546-43c9-93f7-23997583fecf is going to be updated. [ 1171.416604] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada in Status: SUCCESS [ 1171.416777] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada deletion is rescheduled due to dependency. [ 1171.416890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.419366] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.419490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.419563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.419794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.423227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.430364] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: IN_PROGRESS for 2s [ 1171.456768] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.456921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.457008] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.457262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.457463] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.457538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.457583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.457726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.457811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.457895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.458051] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.458146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.458203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.458342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.458471] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.458560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.458619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.458749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.458821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.458899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.458987] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.471986] env[69358]: INFO networking_nsxv3.common.synchronization [req-49ce4591-ea9f-4f0b-97b3-db3c993b426b req-9d69d875-ca53-4e15-81bd-f3105b687050 service nova] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_rules [ 1171.472179] env[69358]: INFO networking_nsxv3.common.synchronization [req-49ce4591-ea9f-4f0b-97b3-db3c993b426b req-9d69d875-ca53-4e15-81bd-f3105b687050 service nova] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1171.472746] env[69358]: INFO networking_nsxv3.common.synchronization [req-49ce4591-ea9f-4f0b-97b3-db3c993b426b req-9d69d875-ca53-4e15-81bd-f3105b687050 service nova] Enqueued Resource ID: 64987207-ee0c-4531-bf02-3e8bc96c70d3 with Priority: HIGHEST for action port [ 1171.472746] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_rules [ 1171.472746] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1171.472746] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64987207-ee0c-4531-bf02-3e8bc96c70d3 with Priority: HIGHEST for action port [ 1171.473252] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.473367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.473431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.473633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.473759] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.474567] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.474663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.474845] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-64987207-ee0c-4531-bf02-3e8bc96c70d3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.474944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64987207-ee0c-4531-bf02-3e8bc96c70d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.475020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64987207-ee0c-4531-bf02-3e8bc96c70d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.475324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64987207-ee0c-4531-bf02-3e8bc96c70d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.475324] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64987207-ee0c-4531-bf02-3e8bc96c70d3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.961407] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b: rpc.has_security_group_logging(os_id): False [ 1171.977511] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.977695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.977916] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64987207-ee0c-4531-bf02-3e8bc96c70d3 with status ACTIVE [ 1171.978130] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.978302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.978376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.978656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.978759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.978994] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.979168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.979253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.979447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.979553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.979803] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.979903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.979968] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.980236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.980311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.980390] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64987207-ee0c-4531-bf02-3e8bc96c70d3 is going to be updated. [ 1171.982135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.982236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.982305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.982455] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.982537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.982705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.982800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.982862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.982999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.983089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.983425] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.983551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.983599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.983727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.983803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.983981] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.984086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.984150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.984284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.984360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.984442] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1172.005339] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.005479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.005546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.005746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.005881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.006846] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64987207-ee0c-4531-bf02-3e8bc96c70d3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.047980] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.048330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.048442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.048676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.048851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.064948] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1173.144855] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab11f00-3987-4b05-b006-d9576475f847 in Status: SUCCESS [ 1173.144855] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 deletion is rescheduled due to dependency. [ 1173.144855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.439554] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: SUCCESS [ 1173.439792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.439962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.440183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.440363] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.440479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.440543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.440685] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.440765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.440858] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.943292] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.075741] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1174.075984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.445949] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.948547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.948712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.948788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.949020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.949114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.949215] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662b0a83-6546-43c9-93f7-23997583fecf is going to be updated. [ 1174.977572] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.977735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.977776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.977977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.978138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.986193] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: IN_PROGRESS for 2s [ 1176.473969] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1176.474306] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1176.996850] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: SUCCESS [ 1176.997095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.997289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.997501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.997690] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.997803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.997869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.998024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.998126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.998219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.998309] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.500799] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.003602] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 662b0a83-6546-43c9-93f7-23997583fecf: rpc.has_security_group_logging(os_id): False [ 1178.021534] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.021700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.021772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.021999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.022115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.022379] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.022477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.022541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.022696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.022766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.022853] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 662b0a83-6546-43c9-93f7-23997583fecf is going to be updated. [ 1178.087259] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.087435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.087510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.087737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.087885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.100309] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: IN_PROGRESS for 2s [ 1179.625599] env[69358]: INFO networking_nsxv3.common.synchronization [req-6565ca95-9e7a-47d9-ac2e-9bd0c2baef05 req-916ca8c4-b3cc-4c8c-9173-ca8c5d0bda3b tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_members [ 1179.626301] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGHEST for action security_group_members [ 1179.627337] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-193bc791-0b82-49f5-a278-c6f34ab0eaf3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.627337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.627337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.627337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.627562] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.627640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.627722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.627916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.628041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.628177] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.118562] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: SUCCESS [ 1180.118562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.132042] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.132042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.132042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.132042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.156150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.156150] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.156150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.156150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.156150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.156150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.156150] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 is going to be updated. [ 1180.182271] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.182271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.182271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.182271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.182271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.190862] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 in Status: IN_PROGRESS for 2s [ 1181.177341] env[69358]: INFO networking_nsxv3.common.synchronization [None req-309c8227-cdad-42f5-a812-ba8a479e02c2 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1181.178273] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1181.178273] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.178432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.178472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.178696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.178847] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.178946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.179016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.179164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.179259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.179356] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.684521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.684854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.684934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.686779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.686779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.686895] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.687531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.687531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.687531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.687531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.687702] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be deleted. [ 1181.714602] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.714729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.714804] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.715068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.715195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.715352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.200272] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 in Status: SUCCESS [ 1182.200607] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 deletion is rescheduled due to dependency. [ 1182.200607] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.331955] env[69358]: INFO networking_nsxv3.common.synchronization [None req-2efce445-872c-4727-ab67-937823a3981c tempest-AttachVolumeShelveTestJSON-2021849226 tempest-AttachVolumeShelveTestJSON-2021849226-project-member] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_rules [ 1182.332499] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_rules [ 1182.332804] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.332944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.333025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.333298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.333383] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.442657] env[69358]: INFO networking_nsxv3.common.synchronization [None req-0cbe3884-754e-405d-80bc-6a5eff9b4c83 tempest-AttachVolumeShelveTestJSON-2021849226 tempest-AttachVolumeShelveTestJSON-2021849226-project-member] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_rules [ 1182.444374] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_rules [ 1182.444374] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.444374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.856421] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.856421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.856421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.856421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.856421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.856421] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 already deleted. [ 1182.856421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.856421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.856421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.856421] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.378144] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.378144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.378144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.378144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.378144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.378144] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 already deleted. [ 1183.378144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.699861] env[69358]: INFO networking_nsxv3.common.synchronization [req-0700e9b8-7c82-4903-bd95-334660246871 req-e450f964-4eb0-483d-bc52-66ca56923faa tempest-ServerActionsTestOtherB-1009679498 tempest-ServerActionsTestOtherB-1009679498-project-member] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1186.700080] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1186.700995] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.700995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.700995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.701264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.701317] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.701424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.701487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.701655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.702365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.702365] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.203879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.204092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.204170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.204425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.225409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.225659] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.225779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.225847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.226059] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.226143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.226236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1187.250350] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.250496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.250580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.250781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.250931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.257995] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1189.268213] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1189.268572] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b deletion is rescheduled due to dependency. [ 1189.268572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.932331] env[69358]: INFO networking_nsxv3.common.synchronization [req-0101511f-641b-43ac-8826-525276bb9a72 req-7fc8d574-a5f3-4789-b489-4a41952327df tempest-AttachVolumeShelveTestJSON-2021849226 tempest-AttachVolumeShelveTestJSON-2021849226-project-member] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_members [ 1189.932860] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_members [ 1189.933281] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.933281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.933281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.933521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.933521] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.933621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.933776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.933839] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.933916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.934162] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.341748] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-866 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.342081] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.342127] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.342507] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.342648] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.342831] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.342955] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.343219] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.343379] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.343615] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.343736] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.343865] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.343981] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.344122] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.344237] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.344391] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.362257] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.362426] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1190.362575] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.362744] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.363052] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.363220] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.363373] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.363651] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.363798] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b5bfeb-61f7-4045-8530-2bbe8e40199e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.435790] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.435945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.436035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.436254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.436348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.436544] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.436642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.436704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.436851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.436928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.437021] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 already deleted. [ 1190.437168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.866477] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.866699] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.866832] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.867202] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.867297] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.867458] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port d3b5bfeb-61f7-4045-8530-2bbe8e40199e not found, creating... [ 1190.867722] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.867883] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.868013] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.868298] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.868451] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.868736] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.868898] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.869043] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.869262] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.869411] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.869548] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: d3b5bfeb-61f7-4045-8530-2bbe8e40199e is going to be created. [ 1190.880879] env[69358]: INFO networking_nsxv3.common.synchronization [req-96a5afa3-d6af-4f56-80b1-efdeeb94e136 req-910f8297-6a52-4683-ad09-f091385f7972 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1190.881148] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1190.881691] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.881806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.881880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.882064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.882219] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.882319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.882387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.882534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.882616] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.882712] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.889178] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.889373] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.889501] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.889738] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.889955] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.890189] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.385197] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.385484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.385520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.385724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.385818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.386085] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.386194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.386291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.386465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.386584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.386693] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1191.413596] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.413755] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.413817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.414055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.414237] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.423041] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1191.521502] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.521742] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.521887] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.522186] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.522469] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.522644] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.522826] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.523086] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.523358] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.523635] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1191.523765] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.523882] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.524014] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.524140] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1191.524264] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.524420] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.544097] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.544285] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1191.544409] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.544592] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.544980] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-36de46da-de90-4ca1-b5d4-64f29fd6a18f taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.545222] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.545349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.545692] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.545855] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36de46da-de90-4ca1-b5d4-64f29fd6a18f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.048524] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.048749] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.048882] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.049192] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.049349] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.049543] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 36de46da-de90-4ca1-b5d4-64f29fd6a18f not found, creating... [ 1192.049804] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.049967] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.050103] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.050334] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.050480] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.050768] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.050956] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.051056] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.051344] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.051529] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.051735] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 36de46da-de90-4ca1-b5d4-64f29fd6a18f is going to be created. [ 1192.072514] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.072745] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.072874] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.073169] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.077779] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.077779] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.308541] env[69358]: INFO networking_nsxv3.common.synchronization [None req-9f4c2fcf-eee5-44f2-a8c3-9956981f24e5 tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_rules [ 1192.309179] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_rules [ 1192.309385] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.309624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.309624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.309964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.310056] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.379443] env[69358]: INFO networking_nsxv3.common.synchronization [None req-f6b210a1-af0e-4448-8e37-4219a1c87cfb tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_rules [ 1192.380061] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_rules [ 1192.380243] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.380342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.389212] env[69358]: INFO networking_nsxv3.common.synchronization [req-0101511f-641b-43ac-8826-525276bb9a72 req-d4522a38-be63-4c86-91ab-5dd7065b056c service nova] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_rules [ 1192.389494] env[69358]: INFO networking_nsxv3.common.synchronization [req-0101511f-641b-43ac-8826-525276bb9a72 req-d4522a38-be63-4c86-91ab-5dd7065b056c service nova] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_members [ 1192.389623] env[69358]: INFO networking_nsxv3.common.synchronization [req-0101511f-641b-43ac-8826-525276bb9a72 req-d4522a38-be63-4c86-91ab-5dd7065b056c service nova] Enqueued Resource ID: d3b5bfeb-61f7-4045-8530-2bbe8e40199e with Priority: HIGHEST for action port [ 1192.389820] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_rules [ 1192.389940] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_members [ 1192.390043] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3b5bfeb-61f7-4045-8530-2bbe8e40199e with Priority: HIGHEST for action port [ 1192.390518] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.390644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.390713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.390903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.390982] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.391813] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.391927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.391993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.392266] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.392432] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.392529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.392585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.392738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.392821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.393077] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.393601] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.393746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.393779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.393906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.393977] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b5bfeb-61f7-4045-8530-2bbe8e40199e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.451169] env[69358]: INFO networking_nsxv3.common.synchronization [req-d909dd1a-781f-44ac-bfd3-a4820deb642a req-a775403c-c076-43dd-9d38-b8b691440455 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 1192.451169] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 1192.451287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.451436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.451481] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.451909] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.451909] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.452128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.452128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.452341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.452561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.452561] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.749504] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.749966] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.750178] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.750505] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.750984] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.751322] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.751662] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.751957] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.752179] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.752631] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.752823] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.752986] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.753180] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.753402] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.753599] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.753810] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.772700] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.773101] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1192.773318] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.773545] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.773877] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-e51772d5-f27e-4502-b935-d32993afb36d taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.774119] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.774342] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.775336] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.775573] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51772d5-f27e-4502-b935-d32993afb36d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.829637] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.829784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.829858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.830417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.830566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.830708] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 already deleted. [ 1192.831835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.832118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.832611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.833487] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.895764] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.896681] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.896790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.896929] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3b5bfeb-61f7-4045-8530-2bbe8e40199e with status ACTIVE [ 1192.897107] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.897224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.897292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.897486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.897611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.897802] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.897925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.897954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.898589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.898589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.898758] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.898936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.899077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.899298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.899615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.899748] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3b5bfeb-61f7-4045-8530-2bbe8e40199e is going to be updated. [ 1192.901811] env[69358]: INFO networking_nsxv3.common.synchronization [req-d95a7059-cd3d-4f7e-a6d3-1b148d7586c3 req-55370129-2c93-4422-a930-585eefab09be service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 1192.902008] env[69358]: INFO networking_nsxv3.common.synchronization [req-d95a7059-cd3d-4f7e-a6d3-1b148d7586c3 req-55370129-2c93-4422-a930-585eefab09be service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1192.902235] env[69358]: INFO networking_nsxv3.common.synchronization [req-d95a7059-cd3d-4f7e-a6d3-1b148d7586c3 req-55370129-2c93-4422-a930-585eefab09be service nova] Enqueued Resource ID: 36de46da-de90-4ca1-b5d4-64f29fd6a18f with Priority: HIGHEST for action port [ 1192.903218] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 1192.903218] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1192.903218] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36de46da-de90-4ca1-b5d4-64f29fd6a18f with Priority: HIGHEST for action port [ 1192.903873] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.904060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.904204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.904495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.904621] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.905406] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.905558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.905662] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.905853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.906137] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.906137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.906293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.906540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.906540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.906695] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.907473] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-36de46da-de90-4ca1-b5d4-64f29fd6a18f taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.907698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.907698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.907948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.908095] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36de46da-de90-4ca1-b5d4-64f29fd6a18f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.922788] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.922908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.922946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.923123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.923308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.923485] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.955211] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.955391] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.955489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.955736] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.955849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.956065] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.956173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.956238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.956390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.956465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.956552] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be deleted. [ 1192.987028] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.987028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.987028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.987302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.987302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.987410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.278255] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.278968] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.278968] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.278968] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.279152] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.279235] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port e51772d5-f27e-4502-b935-d32993afb36d not found, creating... [ 1193.279492] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.279656] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.279802] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.279996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.280164] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.280519] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.280682] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.280805] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.281032] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.281177] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.281349] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: e51772d5-f27e-4502-b935-d32993afb36d is going to be created. [ 1193.307902] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.308106] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.309524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.309524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.309524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.309524] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.352914] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.352914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.352914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.352914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.352914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.352914] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 already deleted. [ 1193.352914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.403554] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.410064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.410180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.410332] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.411587] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36de46da-de90-4ca1-b5d4-64f29fd6a18f with status ACTIVE [ 1193.411679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.411769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.411834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.412042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.412134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.412305] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.412400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.412464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.412611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.412689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.412864] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.413129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.413129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.413200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.413233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.413298] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36de46da-de90-4ca1-b5d4-64f29fd6a18f is going to be updated. [ 1193.431360] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1193.431531] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1193.431633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.437232] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.437353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.437437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.437596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.437722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.437863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.905477] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.905668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.905729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.905907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.905992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.906099] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 is going to be created. [ 1193.914902] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.931174] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.931174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.931174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.931174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.931174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.939070] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: UNINITIALIZED for 2s [ 1194.008197] env[69358]: INFO networking_nsxv3.common.synchronization [req-d909dd1a-781f-44ac-bfd3-a4820deb642a req-1b56e84d-be6a-4208-ab27-6ee5b505ca29 service nova] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_rules [ 1194.008197] env[69358]: INFO networking_nsxv3.common.synchronization [req-d909dd1a-781f-44ac-bfd3-a4820deb642a req-1b56e84d-be6a-4208-ab27-6ee5b505ca29 service nova] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 1194.008197] env[69358]: INFO networking_nsxv3.common.synchronization [req-d909dd1a-781f-44ac-bfd3-a4820deb642a req-1b56e84d-be6a-4208-ab27-6ee5b505ca29 service nova] Enqueued Resource ID: e51772d5-f27e-4502-b935-d32993afb36d with Priority: HIGHEST for action port [ 1194.008197] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_rules [ 1194.008197] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 1194.008197] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51772d5-f27e-4502-b935-d32993afb36d with Priority: HIGHEST for action port [ 1194.009585] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.009585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.009585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.009585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.009585] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.010383] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.010517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.010555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.010710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.010851] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.010946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.011014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.011190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.011739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.011739] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.012041] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e51772d5-f27e-4502-b935-d32993afb36d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.012142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.012213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.012368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.012435] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51772d5-f27e-4502-b935-d32993afb36d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.416959] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.417294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.417294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.417471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.417569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.417667] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be created. [ 1194.438792] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.439168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.439168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.439244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.439339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.446757] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: UNINITIALIZED for 2s [ 1194.513762] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.514759] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.514867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.515023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e51772d5-f27e-4502-b935-d32993afb36d with status ACTIVE [ 1194.515178] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.515286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.515353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.515553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.515691] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.515828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.515954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.515954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.516109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.516189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.516369] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.516463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.516525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.516659] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.516759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.516838] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e51772d5-f27e-4502-b935-d32993afb36d is going to be updated. [ 1194.536847] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.536847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.536847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.536847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.536847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.536847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.019103] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.110305] env[69358]: INFO networking_nsxv3.common.synchronization [req-bf836017-957c-4dd2-a65d-3d21ed470aeb req-ba9a0fa7-6b3a-4d0b-8e24-2ac2bad253d5 tempest-ServerActionsTestOtherB-1009679498 tempest-ServerActionsTestOtherB-1009679498-project-member] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1195.110817] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1195.111733] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.111733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.111733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.111733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.111733] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.111733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.111965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.111965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.112034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.112135] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.446159] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-285 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.446519] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.446519] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.446740] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.446989] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.447174] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.447298] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.447515] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.447661] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.447877] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.448162] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.448162] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.448308] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.448411] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.448527] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.448669] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.466308] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.466455] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1195.466601] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.466760] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.467080] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-67ea8f07-856f-41bd-a870-1cecf8ac7a19 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.467284] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.467410] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.467697] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.467843] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ea8f07-856f-41bd-a870-1cecf8ac7a19',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.521714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.521868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.521868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.522080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.522163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.522258] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be created. [ 1195.543702] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.543877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.543951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.544157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.544314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.552581] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: UNINITIALIZED for 2s [ 1195.614447] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.614605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.614703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.614882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.615029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.615241] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.615325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.615366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.615539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.615605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.615661] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1195.640030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.640030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.640030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.640030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.640030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.647645] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1195.948273] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: SUCCESS [ 1195.948830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.948969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.949210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.949438] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.949590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.949660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.949906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.950065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.950878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.950878] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.969557] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.969805] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.969932] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.970225] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.970401] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.970548] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 67ea8f07-856f-41bd-a870-1cecf8ac7a19 not found, creating... [ 1195.970929] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.971124] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.971321] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.971567] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.971722] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.972068] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.972210] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.972343] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.972581] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.972728] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.972877] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 67ea8f07-856f-41bd-a870-1cecf8ac7a19 is going to be created. [ 1195.991320] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.991320] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.991576] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.991616] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.991839] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.992090] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.452961] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.456991] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1196.457306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.457521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.457791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.457982] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.458124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.458213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.458411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.458584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.458584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.458673] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.841977] env[69358]: INFO networking_nsxv3.common.synchronization [req-bf836017-957c-4dd2-a65d-3d21ed470aeb req-e003eb3b-e5b1-4449-be81-8e9b2a05f8a7 service nova] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 1196.842172] env[69358]: INFO networking_nsxv3.common.synchronization [req-bf836017-957c-4dd2-a65d-3d21ed470aeb req-e003eb3b-e5b1-4449-be81-8e9b2a05f8a7 service nova] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1196.842313] env[69358]: INFO networking_nsxv3.common.synchronization [req-bf836017-957c-4dd2-a65d-3d21ed470aeb req-e003eb3b-e5b1-4449-be81-8e9b2a05f8a7 service nova] Enqueued Resource ID: 67ea8f07-856f-41bd-a870-1cecf8ac7a19 with Priority: HIGHEST for action port [ 1196.844448] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 1196.844448] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1196.844448] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67ea8f07-856f-41bd-a870-1cecf8ac7a19 with Priority: HIGHEST for action port [ 1196.844448] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.844448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.844448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.844448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.844448] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.846701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.846701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.846701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-67ea8f07-856f-41bd-a870-1cecf8ac7a19 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.846701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.846701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.846701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.846701] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ea8f07-856f-41bd-a870-1cecf8ac7a19',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.955552] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad508364-f300-40f8-9b87-0edcdb3c9125: rpc.has_security_group_logging(os_id): False [ 1196.960383] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.960538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.960602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.960792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.960948] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.961053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.961119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.961265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.961352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.961487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.961586] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.961748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.961748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.961944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.961997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.962081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.962136] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.962271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.962357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.962440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.962525] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.974112] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.974302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.974302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.974507] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.974598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.974832] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.974934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.974986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.975165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.975244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.975338] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 is going to be created. [ 1197.064428] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.064585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.064658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.064878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.065073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.078977] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: IN_PROGRESS for 2s [ 1197.349046] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.349046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.349046] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67ea8f07-856f-41bd-a870-1cecf8ac7a19 with status ACTIVE [ 1197.349538] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.349538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.349538] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.349917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.349917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.349917] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.350114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.350114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.350238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.350375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.350586] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.350586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.350732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.350782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.350847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.350973] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67ea8f07-856f-41bd-a870-1cecf8ac7a19 is going to be updated. [ 1197.377018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.377249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.377317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.377537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.377680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.377842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.464765] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51af08cc-9a30-4dff-8fb1-ae75e324301c: rpc.has_security_group_logging(os_id): False [ 1197.491012] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.491177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.491287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.491521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.491615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.491848] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.491953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.492031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.492319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.492441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.492650] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.492754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.492822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.492980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.493074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.493299] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.493396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.493459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.493602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.493682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.493760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be created. [ 1197.569650] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: SUCCESS [ 1197.569857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.570029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.570332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.570531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.570645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.570713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.570867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.570960] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.571036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.571132] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.585504] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.585664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.585711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.585915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.586109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.599077] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1197.658130] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1197.658350] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b deletion is rescheduled due to dependency. [ 1197.658486] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.658933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.659015] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.659185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.659863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.659863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.659863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.659863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.659863] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.076020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.076020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.076020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.076020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.076020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.076632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.076632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.076632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.076632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.076632] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.162372] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.578873] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 012ec087-a6ab-4c42-83a0-58a518f9a415: rpc.has_security_group_logging(os_id): False [ 1198.596820] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.596995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.597112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.597376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.597520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.597777] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.597889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.597963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.598141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.598254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.598512] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.598644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.598710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.598868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.598979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.599237] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.599396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.599456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.599641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.599735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.599830] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be created. [ 1198.664796] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.665014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.665120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.665379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.665606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.666815] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.677855] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: IN_PROGRESS for 2s [ 1199.090553] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: SUCCESS [ 1199.090553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.169612] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.169814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.169814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.170065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.170196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.170314] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1199.197450] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.197590] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.197660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.197851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.197988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.207255] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1199.614447] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1199.614701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.992433] env[69358]: INFO networking_nsxv3.common.synchronization [req-16298833-6e55-4344-9c60-2aa012a59bf1 req-054d1cd8-9883-454d-8900-419e05cf0795 tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_members [ 1199.993396] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_members [ 1199.993396] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb445c3-23e7-4fd9-a847-f86f9e461f64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.993599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.993599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.993807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.993962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.994093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.994156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.994305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.994385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.994474] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.330952] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.331201] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.331348] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.331987] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.331987] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.332130] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.332130] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.332391] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.332548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.332759] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.332872] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.332982] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.333103] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.333238] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.333343] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.333476] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.351246] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.351410] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.351548] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.351720] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.352029] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-2914f736-4a55-4806-a266-31f1ff8deda7 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.352207] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-2914f736-4a55-4806-a266-31f1ff8deda7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.352330] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-2914f736-4a55-4806-a266-31f1ff8deda7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.352639] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-2914f736-4a55-4806-a266-31f1ff8deda7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.352781] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2914f736-4a55-4806-a266-31f1ff8deda7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.497762] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.497762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.497762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.497762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.497762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.497762] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.497762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.498053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.498053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.498053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.498150] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 already deleted. [ 1200.498222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.692010] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: SUCCESS [ 1200.692301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.720270] env[69358]: INFO networking_nsxv3.common.synchronization [req-9c761168-f738-4508-abdf-f3054d648d90 req-4ffb2191-14fb-4d58-93f1-404316367d58 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 1200.720772] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGHEST for action security_group_members [ 1200.721142] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.721208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.721287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.721442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.721619] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.721689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.721798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.721858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.721938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.722073] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.764648] env[69358]: INFO networking_nsxv3.common.synchronization [req-9c761168-f738-4508-abdf-f3054d648d90 req-4ffb2191-14fb-4d58-93f1-404316367d58 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: e51772d5-f27e-4502-b935-d32993afb36d with Priority: HIGHEST for action port [ 1200.765157] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51772d5-f27e-4502-b935-d32993afb36d with Priority: HIGHEST for action port [ 1200.765510] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e51772d5-f27e-4502-b935-d32993afb36d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.765646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.765710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.765918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.766011] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51772d5-f27e-4502-b935-d32993afb36d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.854830] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.855130] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.855288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.855570] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.855723] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.855879] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 2914f736-4a55-4806-a266-31f1ff8deda7 not found, creating... [ 1200.856163] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.856342] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.856429] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.856635] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.856782] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.858174] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.858381] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.858515] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.858735] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.858977] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.859044] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 2914f736-4a55-4806-a266-31f1ff8deda7 is going to be created. [ 1200.879114] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.879114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.879114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.879114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.879114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.879350] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-2914f736-4a55-4806-a266-31f1ff8deda7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.217414] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1201.217687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.217793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.218016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.218263] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.218384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.218441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.218592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.218672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.218752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.218868] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.223485] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.223622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.223681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.223822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.223902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.224098] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.224208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.224260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.224389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.224464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.224550] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be updated. [ 1201.254312] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.254312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.254312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.254312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.254312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.262666] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: IN_PROGRESS for 2s [ 1201.269031] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e51772d5-f27e-4502-b935-d32993afb36d with status ACTIVE [ 1201.269031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.269031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.269031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.269243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.269243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.269372] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.269539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.269539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.269690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.269826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.269971] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.270073] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.270126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.270334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.270421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.270508] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e51772d5-f27e-4502-b935-d32993afb36d is going to be updated. [ 1201.288242] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.288419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.288737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.288737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.288852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.288927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e51772d5-f27e-4502-b935-d32993afb36d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.721051] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.740818] env[69358]: INFO networking_nsxv3.common.synchronization [req-16298833-6e55-4344-9c60-2aa012a59bf1 req-9282ae96-573f-4953-b084-50701fb335b6 service nova] Enqueued Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_rules [ 1201.740998] env[69358]: INFO networking_nsxv3.common.synchronization [req-16298833-6e55-4344-9c60-2aa012a59bf1 req-9282ae96-573f-4953-b084-50701fb335b6 service nova] Enqueued Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_members [ 1201.741153] env[69358]: INFO networking_nsxv3.common.synchronization [req-16298833-6e55-4344-9c60-2aa012a59bf1 req-9282ae96-573f-4953-b084-50701fb335b6 service nova] Enqueued Resource ID: 2914f736-4a55-4806-a266-31f1ff8deda7 with Priority: HIGHEST for action port [ 1201.741603] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_rules [ 1201.741735] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_members [ 1201.741831] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2914f736-4a55-4806-a266-31f1ff8deda7 with Priority: HIGHEST for action port [ 1201.742609] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.742737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.742806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.743033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.743092] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.743828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb445c3-23e7-4fd9-a847-f86f9e461f64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.743935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.744007] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.744174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.744315] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.744407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.744467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.744602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.744684] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.744770] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.745479] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-2914f736-4a55-4806-a266-31f1ff8deda7 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.745646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2914f736-4a55-4806-a266-31f1ff8deda7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.745646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2914f736-4a55-4806-a266-31f1ff8deda7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.745780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2914f736-4a55-4806-a266-31f1ff8deda7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.745851] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2914f736-4a55-4806-a266-31f1ff8deda7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.223717] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0f3175f-70d6-4954-936f-524f7ca25a4b: rpc.has_security_group_logging(os_id): False [ 1202.245749] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.245991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.245991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.246215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.246310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.246568] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.246677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.246725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.246866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.246940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.247049] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1202.248230] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.249193] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb445c3-23e7-4fd9-a847-f86f9e461f64 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.249298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.249450] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2914f736-4a55-4806-a266-31f1ff8deda7 with status ACTIVE [ 1202.249686] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.249793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.249856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.250030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.250151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.250312] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.250432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.250515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.250678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.250757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.250951] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.251051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.251154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.251347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.251434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.251519] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2914f736-4a55-4806-a266-31f1ff8deda7 is going to be updated. [ 1202.277872] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.278126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.278126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.278302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.278421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.278574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2914f736-4a55-4806-a266-31f1ff8deda7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.315930] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.316194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.316194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.316359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.316498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.334082] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1202.754701] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.256743] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.256904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.256904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.257205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.257291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.257390] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 is going to be created. [ 1203.269738] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 in Status: SUCCESS [ 1203.269933] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 deletion is rescheduled due to dependency. [ 1203.270026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.279703] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.279832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.279900] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.280172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.280348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.289691] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 in Status: UNINITIALIZED for 2s [ 1203.309749] env[69358]: INFO networking_nsxv3.common.synchronization [req-a0864bd2-605f-450d-9f50-b85c12a3078a req-ee628edd-df9d-4243-a015-d0f6f63bc11a tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1203.310023] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1203.310375] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.310526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.310615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.310815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.310977] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.311089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.311154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.311302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.311382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.311472] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.597791] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.598010] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.598168] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.598447] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.598717] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.598882] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.599010] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.599618] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.600481] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.600728] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1203.600855] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1203.600971] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1203.601114] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1203.601565] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1203.601728] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1203.602430] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.622902] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.623079] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1203.623219] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.623425] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.623745] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-17b78c9d-2888-4c46-8f43-09fbdc9e2764 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.624015] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-17b78c9d-2888-4c46-8f43-09fbdc9e2764" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.624107] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-17b78c9d-2888-4c46-8f43-09fbdc9e2764" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.624383] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-17b78c9d-2888-4c46-8f43-09fbdc9e2764" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.624541] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b78c9d-2888-4c46-8f43-09fbdc9e2764',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.813340] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.813340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.813584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.813584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.813733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.813863] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.813959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.814032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.814176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.814254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.814338] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1203.840789] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.840917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.840993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.841201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.841335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.849811] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1204.127508] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.127758] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.127903] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.128311] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.128536] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.128763] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 17b78c9d-2888-4c46-8f43-09fbdc9e2764 not found, creating... [ 1204.129184] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.129484] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.129705] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.129987] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.130324] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.130771] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.130989] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.131246] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.131615] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.131888] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.132135] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 17b78c9d-2888-4c46-8f43-09fbdc9e2764 is going to be created. [ 1204.152882] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.153120] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.153252] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.153513] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.153765] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.153973] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-17b78c9d-2888-4c46-8f43-09fbdc9e2764" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.362251] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1204.362522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.843304] env[69358]: INFO networking_nsxv3.common.synchronization [req-a0864bd2-605f-450d-9f50-b85c12a3078a req-9b3378e4-e0bb-4be6-882a-e7b954f8f5f5 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1204.843550] env[69358]: INFO networking_nsxv3.common.synchronization [req-a0864bd2-605f-450d-9f50-b85c12a3078a req-9b3378e4-e0bb-4be6-882a-e7b954f8f5f5 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1204.843639] env[69358]: INFO networking_nsxv3.common.synchronization [req-a0864bd2-605f-450d-9f50-b85c12a3078a req-9b3378e4-e0bb-4be6-882a-e7b954f8f5f5 service nova] Enqueued Resource ID: 17b78c9d-2888-4c46-8f43-09fbdc9e2764 with Priority: HIGHEST for action port [ 1204.843869] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1204.843994] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1204.844107] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b78c9d-2888-4c46-8f43-09fbdc9e2764 with Priority: HIGHEST for action port [ 1204.844649] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.844769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.844896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.845235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.845363] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.846229] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.846358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.846649] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-17b78c9d-2888-4c46-8f43-09fbdc9e2764 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.846726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17b78c9d-2888-4c46-8f43-09fbdc9e2764" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.846816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17b78c9d-2888-4c46-8f43-09fbdc9e2764" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.847190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17b78c9d-2888-4c46-8f43-09fbdc9e2764" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.847190] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b78c9d-2888-4c46-8f43-09fbdc9e2764',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.300934] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 in Status: SUCCESS [ 1205.301183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.301357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.301591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.301791] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.301911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.301975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.302144] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.302230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.302320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.302405] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.350075] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.350075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.350075] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17b78c9d-2888-4c46-8f43-09fbdc9e2764 with status ACTIVE [ 1205.350075] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.350075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.350552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.350552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.350552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.350690] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.350690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.350819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.350907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.350979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.351276] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.351388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.351449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.351603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.351676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.351775] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17b78c9d-2888-4c46-8f43-09fbdc9e2764 is going to be updated. [ 1205.374298] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.374545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.374545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.374725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.374858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.375046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17b78c9d-2888-4c46-8f43-09fbdc9e2764" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.804487] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.859016] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1205.859400] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1205.859400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.859493] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.859661] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.859839] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.859955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.860030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.860177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.860257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.860346] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.306315] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eb445c3-23e7-4fd9-a847-f86f9e461f64: rpc.has_security_group_logging(os_id): False [ 1206.324058] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.324058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.324280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.324364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.324472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.324681] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.324778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.324834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.325377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.325377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.325377] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 is going to be created. [ 1206.362973] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.378827] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.379084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.379084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.379303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.380126] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.388544] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 in Status: IN_PROGRESS for 2s [ 1206.865350] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.371748] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.371907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.371962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.372208] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.372296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.372398] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1207.397776] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.397996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.397996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.398206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.398349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.405749] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1208.402034] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 in Status: SUCCESS [ 1208.402422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.415485] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1209.415796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.416057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.416301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.416526] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.416666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.416744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.416936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.417090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.417172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.417277] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.844894] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1209.845111] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1209.920015] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.920324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.920324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.920468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.920626] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.920720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.920791] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.920974] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.921074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.921164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.921334] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.921423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.921482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.921628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.921763] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.921891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.921946] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.922098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.922172] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.922253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.922337] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.125639] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.125885] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.126039] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.126369] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.126678] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.126849] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.126973] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.127250] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.127401] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.127614] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.127735] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.127850] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.127962] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.128145] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.128303] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.128449] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.146434] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.146610] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1210.146755] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.146933] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-670" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.147440] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-36de46da-de90-4ca1-b5d4-64f29fd6a18f taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.147633] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.147732] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.147993] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.148151] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36de46da-de90-4ca1-b5d4-64f29fd6a18f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.425034] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b: rpc.has_security_group_logging(os_id): False [ 1210.443184] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.443335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.443425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.443754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.443884] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.444124] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.444236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.444333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.444511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.444618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.444852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.444980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.445071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.445219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.445331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.445506] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.445577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.445645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.445763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.445830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.445916] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1210.500307] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.500521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.500521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.500727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.500871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.513802] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1210.650423] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.650694] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.650952] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.651525] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.651768] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.652176] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.652465] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.652612] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.652906] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.653097] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.653454] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.653651] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.653793] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.654058] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.654247] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.654409] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 36de46da-de90-4ca1-b5d4-64f29fd6a18f is going to be updated. [ 1210.674430] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.674621] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.674750] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.675010] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.675238] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.675440] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.771204] env[69358]: INFO networking_nsxv3.common.synchronization [req-5125626b-aa1e-4ea9-b631-4fa7387e0e1c req-d85d22fc-9d23-431c-8640-53b6aaf6f71b service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 1211.771204] env[69358]: INFO networking_nsxv3.common.synchronization [req-5125626b-aa1e-4ea9-b631-4fa7387e0e1c req-d85d22fc-9d23-431c-8640-53b6aaf6f71b service nova] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1211.771204] env[69358]: INFO networking_nsxv3.common.synchronization [req-5125626b-aa1e-4ea9-b631-4fa7387e0e1c req-d85d22fc-9d23-431c-8640-53b6aaf6f71b service nova] Enqueued Resource ID: 36de46da-de90-4ca1-b5d4-64f29fd6a18f with Priority: HIGHEST for action port [ 1211.772182] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_rules [ 1211.772633] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1211.776021] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36de46da-de90-4ca1-b5d4-64f29fd6a18f with Priority: HIGHEST for action port [ 1211.776021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.776021] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.776021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.776021] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.776021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.776021] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.778540] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-36de46da-de90-4ca1-b5d4-64f29fd6a18f taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.778679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.778741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.778886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.778960] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36de46da-de90-4ca1-b5d4-64f29fd6a18f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.280981] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.281997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.282233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.282547] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36de46da-de90-4ca1-b5d4-64f29fd6a18f with status ACTIVE [ 1212.282705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.282811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.282876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.283107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.283190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.283372] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.283465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.283537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.284555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.284658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.284860] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.284978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.285127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.285296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.285376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.285464] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36de46da-de90-4ca1-b5d4-64f29fd6a18f is going to be updated. [ 1212.304632] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.304780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.304821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.305067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.305205] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.305364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36de46da-de90-4ca1-b5d4-64f29fd6a18f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.527975] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1212.528265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.783747] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.285714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.285891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.285937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.286201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.286299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.286402] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1213.314790] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.314963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.315013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.315945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.315945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.324066] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1215.334334] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1215.334735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.334735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.334918] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.335151] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.335280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.335343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.335501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.335581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.335664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.335755] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.838584] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.838729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.838801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.839033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.839208] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.839313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.839399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.839562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.839649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.839746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.839901] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.839995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.840063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.840209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.840347] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.840439] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.840500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.840637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.840711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.840803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.840893] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.342584] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51af08cc-9a30-4dff-8fb1-ae75e324301c: rpc.has_security_group_logging(os_id): False [ 1216.364267] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.364409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.364546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.364687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.364771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.365176] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.365336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.365427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.365640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.366079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.366079] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.366231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.366231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.366344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.366449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.366686] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.366799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.366880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.367150] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.367245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.367328] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1216.427939] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.428154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.428227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.428466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.428650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.447020] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1216.773798] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1216.773985] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1218.464066] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1218.464336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.774600] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.774866] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1225.388232] env[69358]: INFO networking_nsxv3.common.synchronization [req-9ebf4e5b-8e4a-4a7d-94b2-3d1fc42fb43c req-8d446068-2e49-4afc-92ef-cef2d4ba4bd3 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 1225.388768] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 1225.389103] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.389222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.389314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.389487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.389645] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.389742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.389800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.389934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.390023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.390119] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.738423] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.738679] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.738804] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.739147] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.739479] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.739668] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.739818] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.740174] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.740319] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.740622] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1225.740809] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1225.740952] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1225.741080] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1225.741205] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1225.741323] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1225.741461] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1225.761688] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1225.762010] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1225.762279] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1225.762643] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-339" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.763103] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-b5a82434-61e9-4d7e-8c28-be90d0814d83 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.763382] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-b5a82434-61e9-4d7e-8c28-be90d0814d83" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.763624] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-b5a82434-61e9-4d7e-8c28-be90d0814d83" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.764113] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-b5a82434-61e9-4d7e-8c28-be90d0814d83" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.764341] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5a82434-61e9-4d7e-8c28-be90d0814d83',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.897160] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.267835] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.268156] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.268680] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.269112] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.269435] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.269760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port b5a82434-61e9-4d7e-8c28-be90d0814d83 not found, creating... [ 1226.270286] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.270576] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.270753] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.271306] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.271569] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.272067] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.272409] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.272589] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.273045] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.273619] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.273619] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: b5a82434-61e9-4d7e-8c28-be90d0814d83 is going to be created. [ 1226.295847] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.296160] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.296276] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.296719] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.297114] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.297315] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-b5a82434-61e9-4d7e-8c28-be90d0814d83" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.403325] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.906136] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.906583] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.906730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.906990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.907207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.907536] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 is going to be updated. [ 1226.935188] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.935442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.935614] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.935880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.936604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.945756] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: IN_PROGRESS for 2s [ 1227.225187] env[69358]: INFO networking_nsxv3.common.synchronization [req-9ebf4e5b-8e4a-4a7d-94b2-3d1fc42fb43c req-1ddf3119-7222-4c0e-b685-e16d5054cf36 service nova] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_rules [ 1227.225187] env[69358]: INFO networking_nsxv3.common.synchronization [req-9ebf4e5b-8e4a-4a7d-94b2-3d1fc42fb43c req-1ddf3119-7222-4c0e-b685-e16d5054cf36 service nova] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 1227.225187] env[69358]: INFO networking_nsxv3.common.synchronization [req-9ebf4e5b-8e4a-4a7d-94b2-3d1fc42fb43c req-1ddf3119-7222-4c0e-b685-e16d5054cf36 service nova] Enqueued Resource ID: b5a82434-61e9-4d7e-8c28-be90d0814d83 with Priority: HIGHEST for action port [ 1227.225187] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_rules [ 1227.225187] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 1227.225187] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a82434-61e9-4d7e-8c28-be90d0814d83 with Priority: HIGHEST for action port [ 1227.225187] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.225187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.225187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.225187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.225187] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.226837] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.227116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.227876] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5a82434-61e9-4d7e-8c28-be90d0814d83 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.228156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5a82434-61e9-4d7e-8c28-be90d0814d83" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.229961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5a82434-61e9-4d7e-8c28-be90d0814d83" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.229961] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5a82434-61e9-4d7e-8c28-be90d0814d83" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.229961] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5a82434-61e9-4d7e-8c28-be90d0814d83',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.613414] env[69358]: INFO networking_nsxv3.common.synchronization [req-7000465c-9d86-4b37-99f9-a39ce6f22a7d req-08f975ab-ba88-440c-9b38-44b17a1377aa tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1227.614138] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1227.614550] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.615762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.615844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.616093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.616275] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.616382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.616447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.616605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.616715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.616816] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.731316] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.731517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.731620] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5a82434-61e9-4d7e-8c28-be90d0814d83 with status ACTIVE [ 1227.731812] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.731927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.731994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.732464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.732464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.732570] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.732627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.732709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.732873] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.732954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.733163] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.733263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.733327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.733472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.733552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.733636] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5a82434-61e9-4d7e-8c28-be90d0814d83 is going to be updated. [ 1227.753106] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.753408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.753408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.753527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.753667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.753855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5a82434-61e9-4d7e-8c28-be90d0814d83" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.118755] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.621595] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.955984] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: SUCCESS [ 1228.955984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.955984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.955984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.956244] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.956244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.956244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.956419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.956463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.956562] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.124032] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.124171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.124171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.124349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.124457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.124567] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662b0a83-6546-43c9-93f7-23997583fecf is going to be updated. [ 1229.149539] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.149669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.149859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.149926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.150096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.157651] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: IN_PROGRESS for 2s [ 1229.458831] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.960732] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.462859] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.462998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.463063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.463295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.463387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.463492] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 is going to be updated. [ 1230.488947] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.489094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.489139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.489300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.489430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.497067] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: IN_PROGRESS for 2s [ 1231.166658] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: SUCCESS [ 1231.167025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.508036] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: SUCCESS [ 1232.508036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.508036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.508036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.508534] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.508534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.508534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.508534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.508696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.508738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.508822] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.615425] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.615651] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1233.011059] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.514233] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32d20126-9c39-42b2-acda-4aa519da54c6: rpc.has_security_group_logging(os_id): False [ 1233.531401] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.531576] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.531642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.531856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.549499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.549801] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.549924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.549982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.550194] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.550510] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.550510] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 is going to be updated. [ 1233.608587] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.608733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.608797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.609045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.609200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.619672] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: IN_PROGRESS for 2s [ 1233.806327] env[69358]: INFO networking_nsxv3.common.synchronization [req-7eda956e-224d-402d-adc8-e8da17d91f2d req-70e07f44-3c06-4da2-9f59-a5853e3f5241 tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1233.806790] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662b0a83-6546-43c9-93f7-23997583fecf with Priority: HIGHEST for action security_group_members [ 1233.807128] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-662b0a83-6546-43c9-93f7-23997583fecf taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.807308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.807308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.807501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.807936] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.807936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.807936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.807936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.808140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.808140] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662b0a83-6546-43c9-93f7-23997583fecf',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.311873] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.312091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.312184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.312390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.312499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.312719] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.312817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.312889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.313072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.313148] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.313255] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662b0a83-6546-43c9-93f7-23997583fecf is going to be updated. [ 1234.338902] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.339062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.339294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.339539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.339678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.347369] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: IN_PROGRESS for 2s [ 1235.633427] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: SUCCESS [ 1235.633740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.358777] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662b0a83-6546-43c9-93f7-23997583fecf in Status: SUCCESS [ 1236.359028] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662b0a83-6546-43c9-93f7-23997583fecf deletion is rescheduled due to dependency. [ 1236.359127] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662b0a83-6546-43c9-93f7-23997583fecf" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.385270] env[69358]: INFO networking_nsxv3.common.synchronization [req-e3621945-9051-4595-b929-c623037ef9bc req-a9926848-d5b7-4525-ba45-1a78c469a698 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1236.385839] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1236.386185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.386312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.386402] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.387025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.387025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.387025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.387025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.387288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.387377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.387470] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.892313] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.892313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.892313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.892730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.892730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.892867] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.892972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.893060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.893244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.893326] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.893417] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1236.920493] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.920640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.920688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.921074] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.921243] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.929192] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1238.940069] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1238.940441] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1238.940441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.895694] env[69358]: INFO networking_nsxv3.common.synchronization [req-ea89f4de-098c-4c39-9e50-a279099b5b6a req-698c2e07-ea84-4bc7-8931-571a1c1206ef tempest-AttachVolumeTestJSON-45129221 tempest-AttachVolumeTestJSON-45129221-project-member] Enqueued Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_members [ 1239.895694] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b753fa61-5f01-4b27-9adf-adec33a7b29e with Priority: HIGHEST for action security_group_members [ 1239.895694] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-b753fa61-5f01-4b27-9adf-adec33a7b29e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.895694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.895694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.895694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.895694] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.895694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.895694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.895694] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.896087] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.896087] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b753fa61-5f01-4b27-9adf-adec33a7b29e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.367256] env[69358]: INFO networking_nsxv3.common.synchronization [None req-cdc6f1da-7089-46bf-8074-f6b8fbdf461d tempest-AttachInterfacesTestJSON-250756474 tempest-AttachInterfacesTestJSON-250756474-project-member] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1240.367770] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGHEST for action security_group_members [ 1240.368314] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.368452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.368518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.368877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.368877] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.368989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.369032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.369161] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.370088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.370199] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.399039] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.399171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.399238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.399445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.399540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.399721] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.399816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.399876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.400051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.400130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.400216] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b753fa61-5f01-4b27-9adf-adec33a7b29e is going to be updated. [ 1240.427875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.428041] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.428088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.428270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.428404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.436617] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b753fa61-5f01-4b27-9adf-adec33a7b29e in Status: IN_PROGRESS for 2s [ 1240.875142] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.875518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.875518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.875642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.875795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.876041] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.876188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.876280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.876465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.876582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.876721] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be updated. [ 1240.901797] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.901984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.902165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.902298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.902435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.910077] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: IN_PROGRESS for 2s [ 1242.445586] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b753fa61-5f01-4b27-9adf-adec33a7b29e in Status: SUCCESS [ 1242.445586] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b753fa61-5f01-4b27-9adf-adec33a7b29e deletion is rescheduled due to dependency. [ 1242.445586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b753fa61-5f01-4b27-9adf-adec33a7b29e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.919779] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c in Status: SUCCESS [ 1242.919779] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c deletion is rescheduled due to dependency. [ 1242.923090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.776434] env[69358]: INFO networking_nsxv3.common.synchronization [None req-40d4712a-a529-464d-95ae-08f641ced2fe None None] Enqueued Resource ID: 2c557abb-e703-4725-9240-c513d45bc415 with Priority: HIGHEST for action port [ 1244.777008] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c557abb-e703-4725-9240-c513d45bc415 with Priority: HIGHEST for action port [ 1244.777359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c557abb-e703-4725-9240-c513d45bc415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.777500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c557abb-e703-4725-9240-c513d45bc415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.777559] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c557abb-e703-4725-9240-c513d45bc415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.777912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c557abb-e703-4725-9240-c513d45bc415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.777912] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c557abb-e703-4725-9240-c513d45bc415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.901923] env[69358]: INFO networking_nsxv3.common.synchronization [req-2b4b2454-8576-4781-91bf-740cfbcbc83d req-39bda5d5-0f5b-4c54-8044-396c41950a66 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1244.902454] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1244.903361] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.903361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.903361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.903615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.903816] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.903942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.904064] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.904441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.904441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.904621] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.282448] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c557abb-e703-4725-9240-c513d45bc415 [ 1245.282448] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.282448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.282448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.282448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.282448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.282448] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c557abb-e703-4725-9240-c513d45bc415 already deleted. [ 1245.282448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c557abb-e703-4725-9240-c513d45bc415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.408850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.408850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.408850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.408850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.408850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.408850] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.408850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.408850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.408850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.409235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.409235] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1245.424496] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.424709] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.424932] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.425344] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.426039] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.426746] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.426991] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.427413] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.427666] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.427971] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1245.428117] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1245.428290] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1245.428497] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1245.428698] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1245.429058] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1245.429314] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1245.438985] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.439177] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.439241] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.439427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.439561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.445757] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1245.445822] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1245.445959] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1245.446162] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.446464] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-9dd742b7-db87-4577-aef2-735f0b092d2c taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.446636] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-9dd742b7-db87-4577-aef2-735f0b092d2c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.446761] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-9dd742b7-db87-4577-aef2-735f0b092d2c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.447122] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-9dd742b7-db87-4577-aef2-735f0b092d2c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.447275] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dd742b7-db87-4577-aef2-735f0b092d2c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.448827] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1245.950720] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.951136] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.953066] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.953066] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.953066] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.953066] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 9dd742b7-db87-4577-aef2-735f0b092d2c not found, creating... [ 1245.953066] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.953066] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.953066] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.953642] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.953642] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.954569] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.954569] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.954569] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.954569] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.954800] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.954837] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 9dd742b7-db87-4577-aef2-735f0b092d2c is going to be created. [ 1245.974769] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.975082] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.975232] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.975577] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.975788] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.976048] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-9dd742b7-db87-4577-aef2-735f0b092d2c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.584478] env[69358]: INFO networking_nsxv3.common.synchronization [None req-3225f2f1-7eea-4bc6-bc4f-eb9bb85b55e4 None None] Enqueued Resource ID: e31c3486-5fac-4c68-bce8-2a439914ae53 with Priority: HIGHEST for action port [ 1246.585843] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31c3486-5fac-4c68-bce8-2a439914ae53 with Priority: HIGHEST for action port [ 1246.585922] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e31c3486-5fac-4c68-bce8-2a439914ae53 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.586132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e31c3486-5fac-4c68-bce8-2a439914ae53" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.586261] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e31c3486-5fac-4c68-bce8-2a439914ae53" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.586654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e31c3486-5fac-4c68-bce8-2a439914ae53" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.586799] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31c3486-5fac-4c68-bce8-2a439914ae53',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.793426] env[69358]: INFO networking_nsxv3.common.synchronization [req-2b4b2454-8576-4781-91bf-740cfbcbc83d req-38c3ff4c-4467-4fc1-bcc7-71d025c14ba0 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1246.793637] env[69358]: INFO networking_nsxv3.common.synchronization [req-2b4b2454-8576-4781-91bf-740cfbcbc83d req-38c3ff4c-4467-4fc1-bcc7-71d025c14ba0 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1246.793826] env[69358]: INFO networking_nsxv3.common.synchronization [req-2b4b2454-8576-4781-91bf-740cfbcbc83d req-38c3ff4c-4467-4fc1-bcc7-71d025c14ba0 service nova] Enqueued Resource ID: 9dd742b7-db87-4577-aef2-735f0b092d2c with Priority: HIGHEST for action port [ 1246.794487] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1246.794659] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1246.794816] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd742b7-db87-4577-aef2-735f0b092d2c with Priority: HIGHEST for action port [ 1246.795245] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.795314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.795369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.795599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.795729] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.797166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.797349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.797735] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dd742b7-db87-4577-aef2-735f0b092d2c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.797933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dd742b7-db87-4577-aef2-735f0b092d2c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.798057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dd742b7-db87-4577-aef2-735f0b092d2c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.798309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dd742b7-db87-4577-aef2-735f0b092d2c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.799597] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dd742b7-db87-4577-aef2-735f0b092d2c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.089773] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e31c3486-5fac-4c68-bce8-2a439914ae53 [ 1247.090135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.090233] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.090289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.090483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.090631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.090758] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e31c3486-5fac-4c68-bce8-2a439914ae53 already deleted. [ 1247.090849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e31c3486-5fac-4c68-bce8-2a439914ae53" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.299895] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.300053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.300247] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dd742b7-db87-4577-aef2-735f0b092d2c with status ACTIVE [ 1247.300501] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.300619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.300693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.300902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.300992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.301178] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.301273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.301331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.301495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.301592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.301777] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.301871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.301931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.302088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.302169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.302279] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dd742b7-db87-4577-aef2-735f0b092d2c is going to be updated. [ 1247.324790] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.324931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.324977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.325215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.325725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.325951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dd742b7-db87-4577-aef2-735f0b092d2c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.458042] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1247.458228] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1247.458277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.458437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.458657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.458838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.458953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.459030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.459181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.459263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.459359] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.961965] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.466038] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.969195] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.969195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.969195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.969195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.969195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.969195] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1248.995253] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.995429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.995473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.995687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.995830] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.005024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1250.752190] env[69358]: INFO networking_nsxv3.common.synchronization [req-8fc91b8b-2f32-444d-8104-15c521a2127a req-55272d20-336b-446d-94ca-7c6b3a031a5f tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1250.752783] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1250.753155] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.753282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.753364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.753649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.753834] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.753940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.754036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.754204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.754330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.754440] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.015030] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1251.015269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.015442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.015703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.015912] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.016049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.016120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.016290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.016365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.016461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.016564] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.068605] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.068846] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-479" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.068940] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-479" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.069296] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-479" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.069602] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.069771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.069895] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.070141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.070296] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.070512] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.070637] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.070776] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.070894] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.071019] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.071126] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.071265] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.091808] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.092030] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1251.092164] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.092353] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-479" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.092749] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-83ddb7f2-6f58-491b-a35f-199ffbae8d96 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.092913] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.092993] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.093431] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.093513] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83ddb7f2-6f58-491b-a35f-199ffbae8d96',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.256652] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.256872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.256966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.257309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.257430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.257674] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.257775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.257858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.258052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.258212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.258354] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de already deleted. [ 1251.258435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.519409] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.519644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.519798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.520134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.520328] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.520433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.520496] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.520665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.520752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.520833] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.520994] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.521093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.521167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.521339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.521485] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.521576] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.521637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.521765] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.521841] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.521923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.522023] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.595873] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.597427] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.597427] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.597427] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.597427] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.597677] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 83ddb7f2-6f58-491b-a35f-199ffbae8d96 not found, creating... [ 1251.597874] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.598133] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.598321] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.598607] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.598811] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.599287] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.599433] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.599622] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.599897] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.600149] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.600327] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 is going to be created. [ 1251.620630] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.620957] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.621127] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.621487] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.621763] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.622090] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.024903] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b: rpc.has_security_group_logging(os_id): False [ 1252.042157] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.042320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.042372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.042584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.042690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.042884] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.042975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.043045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.043218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.043320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.043542] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.043695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.043787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.043921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.043998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.044196] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.044294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.044350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.044492] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.044572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.044652] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1252.124335] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.124502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.124570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.124792] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.124958] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.139998] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1252.319445] env[69358]: INFO networking_nsxv3.common.synchronization [req-8fc91b8b-2f32-444d-8104-15c521a2127a req-79347b39-d79e-4807-b298-f645cc02d6c7 service nova] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_rules [ 1252.319445] env[69358]: INFO networking_nsxv3.common.synchronization [req-8fc91b8b-2f32-444d-8104-15c521a2127a req-79347b39-d79e-4807-b298-f645cc02d6c7 service nova] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1252.319445] env[69358]: INFO networking_nsxv3.common.synchronization [req-8fc91b8b-2f32-444d-8104-15c521a2127a req-79347b39-d79e-4807-b298-f645cc02d6c7 service nova] Enqueued Resource ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with Priority: HIGHEST for action port [ 1252.320028] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_rules [ 1252.320419] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1252.321024] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with Priority: HIGHEST for action port [ 1252.321154] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.321298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.321414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.321754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.321907] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.322905] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.323627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.323627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.323627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.323627] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.323627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.323877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.324017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.324165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.324312] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.325448] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-83ddb7f2-6f58-491b-a35f-199ffbae8d96 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.325448] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.328029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.328029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.328264] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83ddb7f2-6f58-491b-a35f-199ffbae8d96',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.829986] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.830993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.830993] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.832733] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with status ACTIVE [ 1252.833012] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.833197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.833247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.833466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.833580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.833795] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.833899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.833967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.834239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.834239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.834835] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.834835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.834835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.834835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.834835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.834835] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 is going to be updated. [ 1252.853126] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.853298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.853342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.853575] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.853729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.853897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.333505] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.837235] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.837498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.837601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.837944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.838121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.838294] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be created. [ 1253.859762] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.859994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.860077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.860401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.860646] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.870054] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: UNINITIALIZED for 2s [ 1254.157939] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1254.158165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.880037] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: SUCCESS [ 1255.880037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.880037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.880467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.880467] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.880627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.880627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.880705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.880798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.880932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.881037] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.384037] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.384037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.384037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.384037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.384360] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.384360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.384360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.384511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.384511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.384575] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.384699] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.384793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.384855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.384993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.385139] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.385232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.385315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.385422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.385495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.385581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.385760] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.888980] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b9de2d-b892-4ae7-8d9a-4249dc72f9de: rpc.has_security_group_logging(os_id): False [ 1256.906591] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.906806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.906862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.907142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.907235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.907453] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.907566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.907658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.907855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.907959] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.908219] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.908340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.908413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.908598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.908682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.909185] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.909185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.909185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.909185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.909400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.909400] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be created. [ 1256.964104] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.964376] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.964478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.964777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.965047] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.975512] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: IN_PROGRESS for 2s [ 1257.321976] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.322158] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1258.987858] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: SUCCESS [ 1258.988195] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.416708] env[69358]: INFO networking_nsxv3.common.synchronization [req-6595f626-5be0-4f9a-acee-bf23dab5ea4d req-1ca9a31d-f008-41b1-9d00-2521efddeb17 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1259.417275] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1259.417591] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.417713] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.417781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.417982] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.418582] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.418706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.418774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.418938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.419088] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.419191] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.921351] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.921672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.921672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.921802] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.921903] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.922082] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.922245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.922245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.922522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.922522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.922522] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1259.948666] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.948862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.948862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.949108] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.950345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.957405] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1261.971513] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1261.971814] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1261.971814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.418701] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.418701] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1269.419346] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.419744] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.339198] env[69358]: INFO networking_nsxv3.common.synchronization [req-633b2ffa-9889-4063-a989-7dc24855b0ac req-1a1e9554-a96b-4877-b8c9-8da77b21428e tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: af329738-179a-4d1d-a103-db20fb687478 with Priority: HIGHEST for action security_group_members [ 1270.339377] env[69358]: INFO networking_nsxv3.common.synchronization [req-633b2ffa-9889-4063-a989-7dc24855b0ac req-1a1e9554-a96b-4877-b8c9-8da77b21428e tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1270.339907] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af329738-179a-4d1d-a103-db20fb687478 with Priority: HIGHEST for action security_group_members [ 1270.340063] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1270.340474] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-af329738-179a-4d1d-a103-db20fb687478 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.340474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.340558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.340768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.340927] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.341189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.341280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.341438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.341525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.341618] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.342498] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.342606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.342672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.342824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.342964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.343071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.343134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.343290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.343360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.343418] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.380360] env[69358]: INFO networking_nsxv3.common.synchronization [req-633b2ffa-9889-4063-a989-7dc24855b0ac req-1a1e9554-a96b-4877-b8c9-8da77b21428e tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: af329738-179a-4d1d-a103-db20fb687478 with Priority: HIGHEST for action security_group_rules [ 1270.380538] env[69358]: INFO networking_nsxv3.common.synchronization [req-633b2ffa-9889-4063-a989-7dc24855b0ac req-1a1e9554-a96b-4877-b8c9-8da77b21428e tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: af329738-179a-4d1d-a103-db20fb687478 with Priority: HIGHEST for action security_group_members [ 1270.380678] env[69358]: INFO networking_nsxv3.common.synchronization [req-633b2ffa-9889-4063-a989-7dc24855b0ac req-1a1e9554-a96b-4877-b8c9-8da77b21428e tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_rules [ 1270.380811] env[69358]: INFO networking_nsxv3.common.synchronization [req-633b2ffa-9889-4063-a989-7dc24855b0ac req-1a1e9554-a96b-4877-b8c9-8da77b21428e tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1270.380943] env[69358]: INFO networking_nsxv3.common.synchronization [req-633b2ffa-9889-4063-a989-7dc24855b0ac req-1a1e9554-a96b-4877-b8c9-8da77b21428e tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with Priority: HIGHEST for action port [ 1270.381173] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af329738-179a-4d1d-a103-db20fb687478 with Priority: HIGHEST for action security_group_rules [ 1270.381300] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_rules [ 1270.381399] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with Priority: HIGHEST for action port [ 1270.381491] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af329738-179a-4d1d-a103-db20fb687478 with Priority: HIGHEST for action security_group_members [ 1270.381578] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1270.382264] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af329738-179a-4d1d-a103-db20fb687478 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.382384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.382449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.382676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.382735] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.383466] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.383543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.383631] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.383794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.383872] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.384556] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-83ddb7f2-6f58-491b-a35f-199ffbae8d96 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.384665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.384776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.384875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.384944] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83ddb7f2-6f58-491b-a35f-199ffbae8d96',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.385639] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-af329738-179a-4d1d-a103-db20fb687478 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.385728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.385911] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.388155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.628487] env[69358]: INFO networking_nsxv3.common.synchronization [req-b5daa9b4-a70c-4018-9e4a-e2fc6f58c1c1 req-7bb429eb-0bba-4f64-a4e3-7ac55723e292 tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: af329738-179a-4d1d-a103-db20fb687478 with Priority: HIGHEST for action security_group_members [ 1270.628780] env[69358]: INFO networking_nsxv3.common.synchronization [req-b5daa9b4-a70c-4018-9e4a-e2fc6f58c1c1 req-7bb429eb-0bba-4f64-a4e3-7ac55723e292 tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1270.629209] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af329738-179a-4d1d-a103-db20fb687478 with Priority: HIGHEST for action security_group_members [ 1270.630242] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1270.630242] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-af329738-179a-4d1d-a103-db20fb687478 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.630242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.630242] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.630242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.668401] env[69358]: INFO networking_nsxv3.common.synchronization [req-b5daa9b4-a70c-4018-9e4a-e2fc6f58c1c1 req-7bb429eb-0bba-4f64-a4e3-7ac55723e292 tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_rules [ 1270.668619] env[69358]: INFO networking_nsxv3.common.synchronization [req-b5daa9b4-a70c-4018-9e4a-e2fc6f58c1c1 req-7bb429eb-0bba-4f64-a4e3-7ac55723e292 tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1270.668809] env[69358]: INFO networking_nsxv3.common.synchronization [req-b5daa9b4-a70c-4018-9e4a-e2fc6f58c1c1 req-7bb429eb-0bba-4f64-a4e3-7ac55723e292 tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with Priority: HIGHEST for action port [ 1270.671350] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_rules [ 1270.671350] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1270.671350] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with Priority: HIGHEST for action port [ 1270.671350] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.671350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.671350] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.671350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.671350] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-83ddb7f2-6f58-491b-a35f-199ffbae8d96 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.671350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.845366] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.848079] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.891125] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-af329738-179a-4d1d-a103-db20fb687478 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.891125] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.891125] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with status ACTIVE [ 1270.891125] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.891125] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.891125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.891714] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.891714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.891714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.891714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.891714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.891714] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 is going to be updated. [ 1270.916034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.916034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.916034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.916034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.916034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.916034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.916034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.916034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.916034] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83ddb7f2-6f58-491b-a35f-199ffbae8d96',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.348532] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.349568] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.418826] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83ddb7f2-6f58-491b-a35f-199ffbae8d96 with status ACTIVE [ 1271.418826] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.419048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.419048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.419972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.419972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.419972] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.419972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.419972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.419972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.419972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.420308] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.420308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.420308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.420423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.420423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.420512] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83ddb7f2-6f58-491b-a35f-199ffbae8d96 is going to be updated. [ 1271.441235] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.441389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.441453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.441628] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.441780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.441936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83ddb7f2-6f58-491b-a35f-199ffbae8d96" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.852292] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.852292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.852292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.852292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.852292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.852292] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af329738-179a-4d1d-a103-db20fb687478 is going to be created. [ 1271.853043] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.853178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.853222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.853403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.853489] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.853568] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be updated. [ 1271.875671] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.875883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.875883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.876089] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.876246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.883616] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.883763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.883814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.884018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.884163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.885667] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af329738-179a-4d1d-a103-db20fb687478 in Status: UNINITIALIZED for 2s [ 1271.890739] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: IN_PROGRESS for 2s [ 1272.782589] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-866 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.782791] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.782943] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.783251] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.783591] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.783775] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.783900] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.784136] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.784286] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.784589] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1272.784733] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1272.784909] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1272.784962] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1272.785088] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1272.785198] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1272.785335] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1272.803071] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1272.803196] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1272.803340] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1272.803508] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-866" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.803788] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.803961] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.804133] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.804384] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.804527] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b5bfeb-61f7-4045-8530-2bbe8e40199e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.307063] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.307063] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.307063] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.307633] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.307633] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.308037] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.308288] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.308490] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.308710] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.308891] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.309246] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.309482] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.309634] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.309884] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.310071] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.310256] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: d3b5bfeb-61f7-4045-8530-2bbe8e40199e is going to be updated. [ 1273.329013] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.329216] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.329345] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.329589] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.329780] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.330010] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.901018] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af329738-179a-4d1d-a103-db20fb687478 in Status: SUCCESS [ 1273.901018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.901018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.901018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.901018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.901018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.901018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.901018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.901018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.901018] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.901853] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: SUCCESS [ 1273.902169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.902416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.902679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.902955] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.903182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.903338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.903811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.903991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.904172] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.099992] env[69358]: INFO networking_nsxv3.common.synchronization [req-95069cdd-ffd1-4798-8e8e-27e9413589f7 req-8420c55d-35ab-441c-9d9c-a60652a2aa81 service nova] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_rules [ 1274.100404] env[69358]: INFO networking_nsxv3.common.synchronization [req-95069cdd-ffd1-4798-8e8e-27e9413589f7 req-8420c55d-35ab-441c-9d9c-a60652a2aa81 service nova] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_members [ 1274.100404] env[69358]: INFO networking_nsxv3.common.synchronization [req-95069cdd-ffd1-4798-8e8e-27e9413589f7 req-8420c55d-35ab-441c-9d9c-a60652a2aa81 service nova] Enqueued Resource ID: d3b5bfeb-61f7-4045-8530-2bbe8e40199e with Priority: HIGHEST for action port [ 1274.100565] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_rules [ 1274.100693] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_members [ 1274.100790] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3b5bfeb-61f7-4045-8530-2bbe8e40199e with Priority: HIGHEST for action port [ 1274.101332] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.101453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.101524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.101726] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.101809] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.102741] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.102860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.102924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.103094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.103268] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.103381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.103443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.103587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.103700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.103754] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.104454] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.104558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.104622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.104777] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.104856] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b5bfeb-61f7-4045-8530-2bbe8e40199e',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.405976] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.406316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.406316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.406443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.406539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.406741] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.407099] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.407227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.407397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.407483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.407589] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af329738-179a-4d1d-a103-db20fb687478 is going to be deleted. [ 1274.408845] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.439557] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.439779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.439779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.439977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.440239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.440239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.440405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.440595] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.441025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.441025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.441025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.441272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.441325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.441413] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.606656] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.606950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.607214] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3b5bfeb-61f7-4045-8530-2bbe8e40199e with status ACTIVE [ 1274.607408] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.607520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.607587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.607800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.607890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.608114] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.608198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.608234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.608380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.608461] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.608655] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.608817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.608817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.608937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.609017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.609105] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3b5bfeb-61f7-4045-8530-2bbe8e40199e is going to be updated. [ 1274.610193] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.639348] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.639484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.639557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.639757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.639886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.640050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3b5bfeb-61f7-4045-8530-2bbe8e40199e" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.911653] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.943879] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.944203] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.944322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.944543] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.944634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.944835] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.944933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.944996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.945171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.945231] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.945317] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af329738-179a-4d1d-a103-db20fb687478 already deleted. [ 1274.945396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.945548] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.945692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.945830] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.945924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.945981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.946129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.946202] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.946310] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.112201] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.318016] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c68f9ca-5c27-40a7-9641-57b394003039 req-2ad65350-d592-4e00-b449-3519755d9d62 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1275.318534] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1275.318853] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.319013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.319067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.319234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.319391] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.319546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.319546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.319688] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.319772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.319863] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.413918] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.414283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.414283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.414356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.414454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.414552] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be updated. [ 1275.446218] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.446356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.446467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.446638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.446779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.447944] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.448100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.448165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.448336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.448421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.448594] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.448710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.448746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.448881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.448949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.449808] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af329738-179a-4d1d-a103-db20fb687478 already deleted. [ 1275.449929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.450043] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.461920] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: IN_PROGRESS for 2s [ 1275.614523] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.614523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.614523] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.615125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.615125] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.615125] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 is going to be updated. [ 1275.641044] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.641605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.641605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.641605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.641728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.650276] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: IN_PROGRESS for 2s [ 1275.728780] env[69358]: INFO networking_nsxv3.common.synchronization [req-cf0f7c7f-03b5-4412-877a-6d7c561b9776 req-47ffb182-1cb2-4ca9-824d-2572d599293c tempest-ServerRescueTestJSONUnderV235-1073632846 tempest-ServerRescueTestJSONUnderV235-1073632846-project-member] Enqueued Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1275.729322] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de with Priority: HIGHEST for action security_group_members [ 1275.730423] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.730423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.797879] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.798089] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.798261] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.798582] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.798835] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.798994] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.799133] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.799346] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.799570] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.799794] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1275.799915] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1275.800041] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1275.800177] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1275.800264] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1275.800374] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1275.800507] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1275.818144] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1275.818294] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1275.818436] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1275.818608] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.818885] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-d5cce494-ec57-4725-ba31-616eae83518a taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.819066] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-d5cce494-ec57-4725-ba31-616eae83518a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.819194] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-d5cce494-ec57-4725-ba31-616eae83518a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.819513] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-d5cce494-ec57-4725-ba31-616eae83518a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.819675] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5cce494-ec57-4725-ba31-616eae83518a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.822043] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.822154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.822206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.822321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.822408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.822576] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.822680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.822728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.822862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.822937] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.823074] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1275.846510] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.846629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.846697] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.846893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.847040] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.857825] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1275.953730] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af329738-179a-4d1d-a103-db20fb687478',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.322320] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.322541] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.322660] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.322961] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.323129] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.323293] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port d5cce494-ec57-4725-ba31-616eae83518a not found, creating... [ 1276.323548] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.323709] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.323830] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.324063] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.324209] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.324489] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.324652] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.324771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.324983] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.325173] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.325326] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: d5cce494-ec57-4725-ba31-616eae83518a is going to be created. [ 1276.344538] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.344720] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.344841] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.345142] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.345382] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.345598] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-d5cce494-ec57-4725-ba31-616eae83518a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.455730] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af329738-179a-4d1d-a103-db20fb687478: rpc.has_security_group_logging(os_id): False [ 1276.476960] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.477184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.477244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.477465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.477554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.477750] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.477850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.477916] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.478076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.478244] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.478436] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af329738-179a-4d1d-a103-db20fb687478 is going to be created. [ 1276.494752] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/af329738-179a-4d1d-a103-db20fb687478], does not exist path=[/infra/domains/default/groups/af329738-179a-4d1d-a103-db20fb687478]."\n}' [ 1276.494881] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af329738-179a-4d1d-a103-db20fb687478 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/af329738-179a-4d1d-a103-db20fb687478 [ 1276.496031] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1276.546631] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.546793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.546872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.547092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.548371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.548585] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.548679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.548749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.548911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.548991] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.549170] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.549262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.549316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.549450] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.549544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.549634] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af329738-179a-4d1d-a103-db20fb687478 is going to be created. [ 1276.566766] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/af329738-179a-4d1d-a103-db20fb687478], does not exist path=[/infra/domains/default/groups/af329738-179a-4d1d-a103-db20fb687478]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/af329738-179a-4d1d-a103-db20fb687478 [ 1276.566931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af329738-179a-4d1d-a103-db20fb687478" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.567161] env[69358]: Traceback (most recent call last): [ 1276.567243] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1276.567243] env[69358]: return func(*args, **kwargs) [ 1276.567243] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1276.567243] env[69358]: res.raise_for_status() [ 1276.567243] env[69358]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1276.567243] env[69358]: raise HTTPError(http_error_msg, response=self) [ 1276.567243] env[69358]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/af329738-179a-4d1d-a103-db20fb687478 [ 1276.567243] env[69358]: During handling of the above exception, another exception occurred: [ 1276.567243] env[69358]: Traceback (most recent call last): [ 1276.567243] env[69358]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1276.567243] env[69358]: listener.cb(fileno) [ 1276.567243] env[69358]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1276.567243] env[69358]: result = function(*args, **kwargs) [ 1276.567243] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1276.567243] env[69358]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1276.567243] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1276.567243] env[69358]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1276.567243] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1276.567243] env[69358]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1276.567243] env[69358]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1276.567243] env[69358]: res.raise_for_status() [ 1276.567243] env[69358]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1276.567243] env[69358]: raise HTTPError(http_error_msg, response=self) [ 1276.568056] env[69358]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/af329738-179a-4d1d-a103-db20fb687478 [ 1276.568056] env[69358]: Removing descriptor: 49 [ 1277.036478] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c68f9ca-5c27-40a7-9641-57b394003039 req-ec2e748c-5464-4753-ac23-0a4559f462f6 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1277.036725] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c68f9ca-5c27-40a7-9641-57b394003039 req-ec2e748c-5464-4753-ac23-0a4559f462f6 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1277.037020] env[69358]: INFO networking_nsxv3.common.synchronization [req-7c68f9ca-5c27-40a7-9641-57b394003039 req-ec2e748c-5464-4753-ac23-0a4559f462f6 service nova] Enqueued Resource ID: d5cce494-ec57-4725-ba31-616eae83518a with Priority: HIGHEST for action port [ 1277.038091] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1277.038307] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1277.039031] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5cce494-ec57-4725-ba31-616eae83518a with Priority: HIGHEST for action port [ 1277.039031] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.039031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.039031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.039338] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.039466] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.040811] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.041085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.041377] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5cce494-ec57-4725-ba31-616eae83518a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.041561] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5cce494-ec57-4725-ba31-616eae83518a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.041691] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5cce494-ec57-4725-ba31-616eae83518a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.042281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5cce494-ec57-4725-ba31-616eae83518a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.042281] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5cce494-ec57-4725-ba31-616eae83518a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.471337] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: SUCCESS [ 1277.471700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.471700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.471920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.472135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.472274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.472342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.472528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.472635] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.472722] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.542720] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.542720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.544295] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5cce494-ec57-4725-ba31-616eae83518a with status ACTIVE [ 1277.544477] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.544617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.544691] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.544880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.544962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.545205] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.545459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.545459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.545654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.545654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.545820] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.545927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.545986] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.546156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.546235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.546289] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5cce494-ec57-4725-ba31-616eae83518a is going to be updated. [ 1277.566148] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.566356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.566403] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.566569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.566712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.566860] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5cce494-ec57-4725-ba31-616eae83518a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.660042] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: SUCCESS [ 1277.660260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.660429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.660654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.660852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.660963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.661028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.661174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.661253] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.661339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.661429] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.867734] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1277.867921] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1277.868038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.868187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.868446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.868643] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.868759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.868856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.868990] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.869079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.869181] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.975017] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.975257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.975329] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.975526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.996308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.996589] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.996753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.996850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.997117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.997256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.997345] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be updated. [ 1278.025675] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.025823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.025897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.026130] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.026267] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.037035] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: IN_PROGRESS for 2s [ 1278.163855] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.168662] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-285 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.168892] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.169049] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.169325] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.169611] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.169779] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.169901] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.170153] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.170310] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.170533] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1278.170650] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1278.170763] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1278.170875] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1278.170986] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1278.171110] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1278.171248] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1278.201648] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1278.201827] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1278.202042] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1278.202172] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-285" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.202649] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-67ea8f07-856f-41bd-a870-1cecf8ac7a19 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.202840] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.202974] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.203352] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.203501] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ea8f07-856f-41bd-a870-1cecf8ac7a19',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.371662] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.665750] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad508364-f300-40f8-9b87-0edcdb3c9125: rpc.has_security_group_logging(os_id): False [ 1278.683624] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.683834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.683834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.684157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.703797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.704202] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.704355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.704459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.704801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.704922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.705029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 is going to be updated. [ 1278.706795] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.706996] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.707209] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.707609] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.707828] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.708290] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.708549] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.708771] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.709194] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.709386] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.709792] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.710048] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.710248] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.710575] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.710766] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.710927] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 67ea8f07-856f-41bd-a870-1cecf8ac7a19 is going to be updated. [ 1278.735080] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.735476] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.735750] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.736186] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.736450] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.736815] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.769191] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.769374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.769441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.769670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.769818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.783056] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: IN_PROGRESS for 2s [ 1278.876083] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.378611] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.378939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.379297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.379416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.379551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.379832] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1279.407934] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.408555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.408679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.408855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.409013] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.419961] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1279.645458] env[69358]: INFO networking_nsxv3.common.synchronization [req-342719de-1aab-4527-815a-804d3bf9d4fa req-f7f65917-6a22-493f-a82f-9c5bf2be8e9b service nova] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 1279.645758] env[69358]: INFO networking_nsxv3.common.synchronization [req-342719de-1aab-4527-815a-804d3bf9d4fa req-f7f65917-6a22-493f-a82f-9c5bf2be8e9b service nova] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1279.646039] env[69358]: INFO networking_nsxv3.common.synchronization [req-342719de-1aab-4527-815a-804d3bf9d4fa req-f7f65917-6a22-493f-a82f-9c5bf2be8e9b service nova] Enqueued Resource ID: 67ea8f07-856f-41bd-a870-1cecf8ac7a19 with Priority: HIGHEST for action port [ 1279.646719] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_rules [ 1279.646934] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1279.647094] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67ea8f07-856f-41bd-a870-1cecf8ac7a19 with Priority: HIGHEST for action port [ 1279.647505] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.647712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.647806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.648096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.648239] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.649315] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.649519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.650323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.650676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.650894] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.651098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.651182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.651459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.651571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.651719] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.652866] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-67ea8f07-856f-41bd-a870-1cecf8ac7a19 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.653057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.653188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.653447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.653631] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ea8f07-856f-41bd-a870-1cecf8ac7a19',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.048171] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: SUCCESS [ 1280.048413] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de deletion is rescheduled due to dependency. [ 1280.048525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.048699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.048920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.049127] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.049272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.049339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.049540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.049603] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.049674] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.158023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.158023] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67ea8f07-856f-41bd-a870-1cecf8ac7a19 with status ACTIVE [ 1280.158023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.158023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.158023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.158023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.158808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.158808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.158808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.158808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.158808] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67ea8f07-856f-41bd-a870-1cecf8ac7a19 is going to be updated. [ 1280.160308] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.183306] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.183464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.183464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.183626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.183827] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.183994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67ea8f07-856f-41bd-a870-1cecf8ac7a19" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.553784] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.553993] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.554085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.554322] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.554419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.554699] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.554864] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.554931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.555164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.555257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.555546] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be updated. [ 1280.584432] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.584656] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.584758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.584976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.585138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.595380] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: IN_PROGRESS for 2s [ 1280.663128] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.797891] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: SUCCESS [ 1280.798138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.167764] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.167764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.167764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.167764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.167764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.167764] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1281.197914] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.198104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.198180] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.198401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.198547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.222419] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1281.430090] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1281.430315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.430487] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.430715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.430909] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.431098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.431200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.431381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.431462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.431552] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.431642] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.933947] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.934188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.934285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.934578] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.934761] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.934872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.934936] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.935158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.935258] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.935384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.935550] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.935648] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.935710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.935855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.936064] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.936173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.936236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.936400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.936478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.936565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.936659] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.439517] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b: rpc.has_security_group_logging(os_id): False [ 1282.457693] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.457964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.457964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.458142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.476308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.476529] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.476651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.476719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.476922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.477024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.477255] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.477382] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.477449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.477608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.477687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.477869] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.477964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.478043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.478178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.478346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.478406] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1282.536783] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.536966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.537054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.537306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.537474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.555283] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1282.615743] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: SUCCESS [ 1282.616051] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de deletion is rescheduled due to dependency. [ 1282.616051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.616220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.616497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.616680] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.616797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.616861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.617029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.617114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.617245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.617345] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.618224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.618488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.618712] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.618824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.618893] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.619054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.619137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.619231] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.121241] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.122373] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.122525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.122594] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.122813] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.122892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.123131] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.123214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.123281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.123433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.123507] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.123594] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be updated. [ 1283.167962] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.168197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.168197] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.168413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.168558] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.191029] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: IN_PROGRESS for 2s [ 1283.234800] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1283.235050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.235260] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.235499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.235701] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.235822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.235883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.236049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.236137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.236225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.236319] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.626345] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b9de2d-b892-4ae7-8d9a-4249dc72f9de: rpc.has_security_group_logging(os_id): False [ 1283.645418] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.645580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.645580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.645780] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.645871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.646082] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.646226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.646286] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.646395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.646626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.646626] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be updated. [ 1283.701860] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.702100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.702100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.702291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.702442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.720047] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: IN_PROGRESS for 2s [ 1283.738602] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.241111] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0f3175f-70d6-4954-936f-524f7ca25a4b: rpc.has_security_group_logging(os_id): False [ 1284.259490] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.259693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.259693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.259919] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.278638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.279046] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.279223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.279303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.279569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.279655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.279774] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1284.335737] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.336050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.336050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.336239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.336399] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.349087] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1284.571314] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1284.571540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.648133] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.648539] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1285.200985] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: SUCCESS [ 1285.201204] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de deletion is rescheduled due to dependency. [ 1285.201305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.733634] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de in Status: SUCCESS [ 1285.734049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.734049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.734251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.734341] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b9de2d-b892-4ae7-8d9a-4249dc72f9de',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.259695] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.259943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.259943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.260221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.278364] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.278601] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b9de2d-b892-4ae7-8d9a-4249dc72f9de is going to be deleted. [ 1286.314956] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.316287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.316287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.316287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.316287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.316287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b9de2d-b892-4ae7-8d9a-4249dc72f9de" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.374514] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1286.374514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.649322] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.649697] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1293.184237] env[69358]: INFO networking_nsxv3.common.synchronization [req-9bc4049f-5952-4cba-b1d7-3c74ff2fc757 req-8f14e983-a1bb-4c2a-9ce4-40d15be2b551 tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 1293.184895] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 1293.185146] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.185272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.185340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.185556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.185711] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.185811] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.185881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.186020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.186096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.186193] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.446642] env[69358]: INFO networking_nsxv3.common.synchronization [req-c5c481ea-94b3-445a-a0bb-d9ef82acafd8 req-a9a3165a-2eee-4045-b526-4c6fcbb0b120 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1293.446933] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1293.447287] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.447405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.447469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.447667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.447816] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.447915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.447970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.448377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.448377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.448377] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.687983] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.950799] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.951025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.951078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.951309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.951379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.951581] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.951724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.951797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.951953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.952046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.952158] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1293.979108] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.979279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.979325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.979582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.979746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.987595] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1294.191046] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.693658] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.693876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.693924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.694176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.694272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.694375] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 is going to be updated. [ 1294.719964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.720168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.720168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.720369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.720474] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.727927] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: IN_PROGRESS for 2s [ 1295.997570] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1295.997949] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1295.997949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.737547] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: SUCCESS [ 1296.737762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.338245] env[69358]: INFO networking_nsxv3.common.synchronization [req-903ea450-841f-4131-87d2-56368a0bbe7d req-beb130a4-d5f1-4547-998f-9e3ea218788e tempest-ServerActionsTestOtherB-1009679498 tempest-ServerActionsTestOtherB-1009679498-project-member] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1298.338775] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGHEST for action security_group_members [ 1298.339096] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.339235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.339345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.339462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.339614] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.339708] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.339768] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.339931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.340075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.340122] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.842429] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.842601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.842668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.842868] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.842967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.843161] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.843255] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.843307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.843456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.843530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.843616] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be updated. [ 1298.872248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.872395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.872466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.872604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.872732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.884366] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: IN_PROGRESS for 2s [ 1300.894963] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0f3175f-70d6-4954-936f-524f7ca25a4b in Status: SUCCESS [ 1300.895274] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b deletion is rescheduled due to dependency. [ 1300.895325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.916627] env[69358]: INFO networking_nsxv3.common.synchronization [req-e63bf405-d863-4d17-a187-93872a393d98 req-08958bbd-c869-4fcb-99a9-ddc35754ed33 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1302.917413] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1302.917499] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.917612] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.917679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.917877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.918100] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.918223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.918390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.918454] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.918536] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.918631] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.196890] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.197048] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.197095] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.197463] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.197799] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.197974] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.198670] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.198924] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.199222] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.199458] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1303.199585] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1303.199702] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1303.199815] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1303.199928] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1303.200049] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1303.200189] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1303.225513] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1303.225682] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1303.225825] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1303.226010] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-669" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.226329] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.226508] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.226631] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.226964] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.227114] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb72fe95-d9b2-4526-8dff-c84c37ff37c8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.421806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.422265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.422401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.422724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.422883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.423289] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.423479] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.423602] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.423856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.424007] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.424171] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1303.447795] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.447964] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.448022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.448198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.448341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.456559] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1303.614852] env[69358]: INFO networking_nsxv3.common.synchronization [req-1f28393c-62f1-4ab1-b349-e715e44d959f req-0f2b044d-9c25-4ff8-9923-72406170f300 tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_members [ 1303.614852] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGHEST for action security_group_members [ 1303.614852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb445c3-23e7-4fd9-a847-f86f9e461f64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.614852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.614852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.614852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.614852] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.615332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.615332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.615332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.615432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.615993] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.730703] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.730956] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.731105] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.731403] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.731780] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.731957] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port fb72fe95-d9b2-4526-8dff-c84c37ff37c8 not found, creating... [ 1303.732228] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.732463] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.732558] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.732834] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.733053] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.733360] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.734450] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.734450] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.734450] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.734450] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.734450] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: fb72fe95-d9b2-4526-8dff-c84c37ff37c8 is going to be created. [ 1303.752982] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.753276] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.753347] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.753896] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.753896] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.754022] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.117576] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.117897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.117897] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.118035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.138024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.138186] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.138359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.138459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.138718] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.138757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.138821] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 is going to be updated. [ 1304.173306] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.173545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.173658] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.173890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.174072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.181779] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 in Status: IN_PROGRESS for 2s [ 1304.447939] env[69358]: INFO networking_nsxv3.common.synchronization [req-e63bf405-d863-4d17-a187-93872a393d98 req-6f963047-f857-4808-a452-62dd2850d4f8 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1304.448185] env[69358]: INFO networking_nsxv3.common.synchronization [req-e63bf405-d863-4d17-a187-93872a393d98 req-6f963047-f857-4808-a452-62dd2850d4f8 service nova] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1304.448389] env[69358]: INFO networking_nsxv3.common.synchronization [req-e63bf405-d863-4d17-a187-93872a393d98 req-6f963047-f857-4808-a452-62dd2850d4f8 service nova] Enqueued Resource ID: fb72fe95-d9b2-4526-8dff-c84c37ff37c8 with Priority: HIGHEST for action port [ 1304.452746] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_rules [ 1304.452746] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1304.452746] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb72fe95-d9b2-4526-8dff-c84c37ff37c8 with Priority: HIGHEST for action port [ 1304.452746] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.452746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.452746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.452746] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.452746] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.453043] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.453084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.455327] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.455327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.455327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.455327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.455327] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb72fe95-d9b2-4526-8dff-c84c37ff37c8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.956167] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.956363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.956532] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb72fe95-d9b2-4526-8dff-c84c37ff37c8 with status ACTIVE [ 1304.956806] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.956945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.957050] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.957310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.957458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.957662] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.957797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.957882] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.958086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.958204] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.958429] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.958547] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.958599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.958693] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.958773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.958854] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb72fe95-d9b2-4526-8dff-c84c37ff37c8 is going to be updated. [ 1304.979109] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.979246] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.979287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.979560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.979560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.979769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb72fe95-d9b2-4526-8dff-c84c37ff37c8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.466101] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1305.466388] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1305.466388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.466541] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.466760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.466942] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.467069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.467135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.467302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.467395] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.467499] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.969387] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.190761] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 in Status: SUCCESS [ 1306.190945] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 deletion is rescheduled due to dependency. [ 1306.191075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.471600] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.974451] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.974644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.974720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.974879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.974972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.975084] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1307.021896] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.022098] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.022163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.022380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.022519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.031681] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1309.043920] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1309.043920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.043920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.043920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.043920] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.043920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.043920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.043920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.043920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.043920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.043920] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.452231] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.452231] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1309.549024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.549024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.549024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.549024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.549024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.549874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.549874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.549874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.549874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.549874] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.054293] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b: rpc.has_security_group_logging(os_id): False [ 1310.069312] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.072025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.072025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.072025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.072606] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.072606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.072606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.072606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.072606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.072606] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1310.128917] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.128917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.128917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.128917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.128917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.138278] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1310.294120] env[69358]: INFO networking_nsxv3.common.synchronization [None req-18d20eac-447f-4cd5-8ba5-b7b4aecd5ba4 None None] Enqueued Resource ID: 64c3054a-0571-47b3-80ea-321b32fb5107 with Priority: HIGHEST for action port [ 1310.294601] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c3054a-0571-47b3-80ea-321b32fb5107 with Priority: HIGHEST for action port [ 1310.294971] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-64c3054a-0571-47b3-80ea-321b32fb5107 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.298069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64c3054a-0571-47b3-80ea-321b32fb5107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.299371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64c3054a-0571-47b3-80ea-321b32fb5107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.299371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64c3054a-0571-47b3-80ea-321b32fb5107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.299371] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64c3054a-0571-47b3-80ea-321b32fb5107',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.801524] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64c3054a-0571-47b3-80ea-321b32fb5107 [ 1310.801761] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.801935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.802048] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.802360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.802518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.802664] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64c3054a-0571-47b3-80ea-321b32fb5107 already deleted. [ 1310.802766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64c3054a-0571-47b3-80ea-321b32fb5107" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.152755] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1312.153104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.198151] env[69358]: INFO networking_nsxv3.common.synchronization [req-faf86a95-9728-44a4-a4a7-7c793d66e7cd req-3be1638c-8f5f-4622-a86b-7b4c0ea3c5ea tempest-ServerActionsTestOtherA-492908702 tempest-ServerActionsTestOtherA-492908702-project-member] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 1312.198855] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGHEST for action security_group_members [ 1312.198970] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.199109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.199190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.199373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.199533] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.199625] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.199706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.199822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.199904] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.199998] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.503755] env[69358]: INFO networking_nsxv3.common.synchronization [None req-b3945f19-eeb9-44ee-a624-bbf64550e678 None None] Enqueued Resource ID: cb4fa173-164a-4667-9194-644dc58e7abe with Priority: HIGHEST for action port [ 1312.504020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4fa173-164a-4667-9194-644dc58e7abe with Priority: HIGHEST for action port [ 1312.504604] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb4fa173-164a-4667-9194-644dc58e7abe taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.504721] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb4fa173-164a-4667-9194-644dc58e7abe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.504789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb4fa173-164a-4667-9194-644dc58e7abe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.505046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb4fa173-164a-4667-9194-644dc58e7abe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.505128] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb4fa173-164a-4667-9194-644dc58e7abe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.703572] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.703771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.703880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.704124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.723849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.724159] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.724294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.724357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.724575] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.724825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.724825] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 is going to be updated. [ 1312.749503] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.749651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.749730] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.749938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.750092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.757525] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: IN_PROGRESS for 2s [ 1313.008236] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb4fa173-164a-4667-9194-644dc58e7abe [ 1313.009232] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.009232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.009232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.009232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.009232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.009636] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb4fa173-164a-4667-9194-644dc58e7abe already deleted. [ 1313.009636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb4fa173-164a-4667-9194-644dc58e7abe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.767731] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d20126-9c39-42b2-acda-4aa519da54c6 in Status: SUCCESS [ 1314.768067] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 deletion is rescheduled due to dependency. [ 1314.768067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.542030] env[69358]: INFO networking_nsxv3.common.synchronization [req-4a7cab06-6e75-42e6-9ce5-e33733ac99c8 req-d9e8be94-c893-4571-bc53-b5cd65465b50 tempest-ServerAddressesTestJSON-1815158387 tempest-ServerAddressesTestJSON-1815158387-project-member] Enqueued Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGHEST for action security_group_members [ 1315.542344] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGHEST for action security_group_members [ 1315.542650] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.542881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.542881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.543423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.543590] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.543808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.543808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.543947] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.544000] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.544103] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.808729] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-100 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.809070] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.809159] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.809474] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.809745] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.809899] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.810027] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.810249] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.810428] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.810990] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1315.810990] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1315.810990] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1315.810990] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1315.811253] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1315.811253] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1315.811355] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1315.831502] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1315.831673] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1315.831797] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1315.831968] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-100" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.832334] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-c17121f5-88a5-4d9d-bc2f-30404b5d2262 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.832541] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-c17121f5-88a5-4d9d-bc2f-30404b5d2262" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.832639] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-c17121f5-88a5-4d9d-bc2f-30404b5d2262" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.832993] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-c17121f5-88a5-4d9d-bc2f-30404b5d2262" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.833102] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17121f5-88a5-4d9d-bc2f-30404b5d2262',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.045920] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.046157] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.046232] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.046568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.046660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.046822] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.046920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.046984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.047152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.047229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.047315] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a already deleted. [ 1316.047431] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.335099] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.335335] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.335551] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.335833] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.335986] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.336162] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port c17121f5-88a5-4d9d-bc2f-30404b5d2262 not found, creating... [ 1316.336433] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.336599] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.336721] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.336946] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.337103] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.337437] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.337620] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.337741] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.337959] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.338110] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.338255] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: c17121f5-88a5-4d9d-bc2f-30404b5d2262 is going to be created. [ 1316.360041] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.360227] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.360340] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.360608] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.360835] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.361073] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-c17121f5-88a5-4d9d-bc2f-30404b5d2262" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.063877] env[69358]: INFO networking_nsxv3.common.synchronization [req-4a7cab06-6e75-42e6-9ce5-e33733ac99c8 req-a20cee75-ee3f-4977-9f0e-b9af8f229de9 service nova] Enqueued Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGHEST for action security_group_rules [ 1317.064304] env[69358]: INFO networking_nsxv3.common.synchronization [req-4a7cab06-6e75-42e6-9ce5-e33733ac99c8 req-a20cee75-ee3f-4977-9f0e-b9af8f229de9 service nova] Enqueued Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGHEST for action security_group_members [ 1317.064304] env[69358]: INFO networking_nsxv3.common.synchronization [req-4a7cab06-6e75-42e6-9ce5-e33733ac99c8 req-a20cee75-ee3f-4977-9f0e-b9af8f229de9 service nova] Enqueued Resource ID: c17121f5-88a5-4d9d-bc2f-30404b5d2262 with Priority: HIGHEST for action port [ 1317.064523] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGHEST for action security_group_rules [ 1317.064601] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGHEST for action security_group_members [ 1317.064691] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c17121f5-88a5-4d9d-bc2f-30404b5d2262 with Priority: HIGHEST for action port [ 1317.065282] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.065426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.065482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.065719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.065804] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.066610] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.066720] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.066786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.066948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.067161] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.067268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.067331] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.067557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.067645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.067755] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.068666] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-c17121f5-88a5-4d9d-bc2f-30404b5d2262 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.068735] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c17121f5-88a5-4d9d-bc2f-30404b5d2262" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.068840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c17121f5-88a5-4d9d-bc2f-30404b5d2262" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.069330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c17121f5-88a5-4d9d-bc2f-30404b5d2262" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.069436] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17121f5-88a5-4d9d-bc2f-30404b5d2262',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.572222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.572222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.572222] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.573121] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c17121f5-88a5-4d9d-bc2f-30404b5d2262 with status ACTIVE [ 1317.573121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.573121] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.573320] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.573363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.573443] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.573595] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.573742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.573742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.573901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.573980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.574174] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.574270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.574313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.574452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.574527] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.574667] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c17121f5-88a5-4d9d-bc2f-30404b5d2262 is going to be updated. [ 1317.593730] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.593874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.593921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.594113] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.594278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.594386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c17121f5-88a5-4d9d-bc2f-30404b5d2262" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.076478] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.581555] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.584535] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.584654] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.584899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.584995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.585556] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a is going to be created. [ 1318.607293] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.607511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.607585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.607797] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.607948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.617040] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a in Status: UNINITIALIZED for 2s [ 1320.629024] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a in Status: SUCCESS [ 1320.629024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.629024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.629024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.629024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.629024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.629024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.629024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.629024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.629024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.629024] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.133328] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.133490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.133540] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.133775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.133935] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.134057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.134207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.134256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.134358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.134409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.134549] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.134641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.134781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.134838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.134964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.135066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.135116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.135251] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.135363] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.135430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.135500] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.140283] env[69358]: INFO networking_nsxv3.common.synchronization [None req-16788898-ff8d-424e-aa81-18b84435ea2b None None] Enqueued Resource ID: ad64e046-47ab-48f0-a996-0cc259289422 with Priority: HIGHEST for action port [ 1321.140497] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad64e046-47ab-48f0-a996-0cc259289422 with Priority: HIGHEST for action port [ 1321.141054] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad64e046-47ab-48f0-a996-0cc259289422 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.141156] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad64e046-47ab-48f0-a996-0cc259289422" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.141221] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad64e046-47ab-48f0-a996-0cc259289422" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.141441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad64e046-47ab-48f0-a996-0cc259289422" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.141527] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad64e046-47ab-48f0-a996-0cc259289422',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.538080] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1321.538239] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1321.640074] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a: rpc.has_security_group_logging(os_id): False [ 1321.648585] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad64e046-47ab-48f0-a996-0cc259289422 [ 1321.648838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.648978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.649054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.649292] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.649385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.649474] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad64e046-47ab-48f0-a996-0cc259289422 already deleted. [ 1321.649551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad64e046-47ab-48f0-a996-0cc259289422" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.657864] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.658499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.658499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.659023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.659106] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.659345] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.659511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.659511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.659677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.659756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.659966] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.660078] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.660140] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.661460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.661460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.661460] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.661460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.661460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.661460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.662374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.662374] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a is going to be created. [ 1321.725517] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.725711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.725776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.725997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.726250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.738096] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a in Status: IN_PROGRESS for 2s [ 1321.752511] env[69358]: INFO networking_nsxv3.common.synchronization [None req-4721f7d4-07f7-4319-8a7a-891434f80862 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_rules [ 1321.753354] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_rules [ 1321.753803] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.753944] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.754021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.754288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.754440] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.844862] env[69358]: INFO networking_nsxv3.common.synchronization [None req-e05865c3-6784-4908-ac5e-f26b3db785b6 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_rules [ 1321.845550] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_rules [ 1321.846241] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.846388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.272875] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.272988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.273038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.273256] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.273347] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.273442] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd280dae-d447-4168-a710-34cbb550aeef already deleted. [ 1322.273526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.273671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.273823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.273908] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.802254] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.802254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.802254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.802254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.802254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.802254] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd280dae-d447-4168-a710-34cbb550aeef already deleted. [ 1322.802254] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.462246] env[69358]: INFO networking_nsxv3.common.synchronization [None req-509c269d-7e65-41ab-bbea-63936d687efb None None] Enqueued Resource ID: e3af66bd-99b1-4b28-a24f-1d868b7d65b8 with Priority: HIGHEST for action port [ 1323.462246] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3af66bd-99b1-4b28-a24f-1d868b7d65b8 with Priority: HIGHEST for action port [ 1323.462664] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3af66bd-99b1-4b28-a24f-1d868b7d65b8 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.462778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3af66bd-99b1-4b28-a24f-1d868b7d65b8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.462848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3af66bd-99b1-4b28-a24f-1d868b7d65b8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.463116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3af66bd-99b1-4b28-a24f-1d868b7d65b8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.463201] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3af66bd-99b1-4b28-a24f-1d868b7d65b8',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.749278] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a in Status: SUCCESS [ 1323.749629] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.965863] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3af66bd-99b1-4b28-a24f-1d868b7d65b8 [ 1323.966351] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.966351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.966351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.966636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.966731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.966954] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3af66bd-99b1-4b28-a24f-1d868b7d65b8 already deleted. [ 1323.966954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3af66bd-99b1-4b28-a24f-1d868b7d65b8" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.038069] env[69358]: INFO networking_nsxv3.common.synchronization [req-460d4ee5-9d3f-4c03-9022-4365aceeda6e req-b5264c6b-73e4-4814-8590-d7b09d6114ac tempest-ServerAddressesTestJSON-1815158387 tempest-ServerAddressesTestJSON-1815158387-project-member] Enqueued Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGHEST for action security_group_members [ 1327.038596] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGHEST for action security_group_members [ 1327.038900] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.039029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.039100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.039300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.039447] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.039544] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.039605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.039750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.039845] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.039939] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.044279] env[69358]: INFO networking_nsxv3.common.synchronization [req-2824318b-1110-4796-a7e6-2070ab7a6903 req-16cc7ce4-f1c1-4c3c-9584-8e7f606066c8 tempest-AttachVolumeShelveTestJSON-2021849226 tempest-AttachVolumeShelveTestJSON-2021849226-project-member] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_members [ 1327.044279] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGHEST for action security_group_members [ 1327.044279] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.044279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.044279] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.044576] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.044576] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.044707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.044707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.044874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.044926] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.044998] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.542355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.542530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.542588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.542799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.542891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.543494] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.543679] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.543751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.543915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.544000] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.544113] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a is going to be updated. [ 1327.546840] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.546954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.547035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.547212] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.547298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.547537] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.547641] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.547707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.547863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.547942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.548043] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 is going to be updated. [ 1327.561333] env[69358]: INFO networking_nsxv3.common.synchronization [req-9109573f-9900-430b-a2eb-66d192a20f8f req-b8d8184f-11dd-44f8-9eb7-af50a9d905d7 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_members [ 1327.561591] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_members [ 1327.562166] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.562282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.562350] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.562604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.562770] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.562870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.562932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.563094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.563174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.563261] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.576693] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.576818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.576888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.577079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.577215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.579832] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.579957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.580037] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.580214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.580346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.589862] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a in Status: IN_PROGRESS for 2s [ 1327.594013] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: IN_PROGRESS for 2s [ 1327.836896] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.837125] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.837253] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.837603] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.837880] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.838053] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.838178] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.838401] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.838578] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.838851] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1327.838977] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1327.839108] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1327.839222] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1327.839336] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1327.839445] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1327.839582] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1327.857791] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1327.857791] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1327.857791] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1327.857791] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.857791] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.857791] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.858210] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.858273] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.858447] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2c6c358-8f43-47b0-afb3-2db70d4b3b50',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.065769] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.066296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.066296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.066296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.066296] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.066530] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.066613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.066613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.066759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.066826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.066914] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd280dae-d447-4168-a710-34cbb550aeef already deleted. [ 1328.066985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.360724] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.360958] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.361103] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.361387] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.361547] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.361713] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port b2c6c358-8f43-47b0-afb3-2db70d4b3b50 not found, creating... [ 1328.362087] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.362248] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.362347] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.362620] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.362700] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.362981] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.363316] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.363316] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.363479] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.363616] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.363758] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: b2c6c358-8f43-47b0-afb3-2db70d4b3b50 is going to be created. [ 1328.386132] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.386324] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.386453] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.386680] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.386898] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.387132] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.079815] env[69358]: INFO networking_nsxv3.common.synchronization [req-9109573f-9900-430b-a2eb-66d192a20f8f req-76bccdbd-26c5-4558-909b-a537d2c83f6b service nova] Enqueued Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_rules [ 1329.080069] env[69358]: INFO networking_nsxv3.common.synchronization [req-9109573f-9900-430b-a2eb-66d192a20f8f req-76bccdbd-26c5-4558-909b-a537d2c83f6b service nova] Enqueued Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_members [ 1329.080189] env[69358]: INFO networking_nsxv3.common.synchronization [req-9109573f-9900-430b-a2eb-66d192a20f8f req-76bccdbd-26c5-4558-909b-a537d2c83f6b service nova] Enqueued Resource ID: b2c6c358-8f43-47b0-afb3-2db70d4b3b50 with Priority: HIGHEST for action port [ 1329.080410] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_rules [ 1329.080536] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_members [ 1329.080633] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c6c358-8f43-47b0-afb3-2db70d4b3b50 with Priority: HIGHEST for action port [ 1329.081547] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.081709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.081800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.083031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.083129] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.083936] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.084067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.084132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.084305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.084509] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.084619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.084681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.084834] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.084917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.085017] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.085890] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.085890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.086012] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.086102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.086175] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2c6c358-8f43-47b0-afb3-2db70d4b3b50',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.588274] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.588464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.588698] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2c6c358-8f43-47b0-afb3-2db70d4b3b50 with status ACTIVE [ 1329.588878] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.588995] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.589075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.589285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.589377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.589541] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.589639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.589702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.589852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.589929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.590128] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.590268] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.590365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.590520] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.590600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.590684] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2c6c358-8f43-47b0-afb3-2db70d4b3b50 is going to be updated. [ 1329.591716] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.602633] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a in Status: SUCCESS [ 1329.602801] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a deletion is rescheduled due to dependency. [ 1329.602906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.607055] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad508364-f300-40f8-9b87-0edcdb3c9125 in Status: SUCCESS [ 1329.607210] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 deletion is rescheduled due to dependency. [ 1329.607304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.614012] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.614143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.614210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.614390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.614513] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.614650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2c6c358-8f43-47b0-afb3-2db70d4b3b50" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.094393] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.597204] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.597387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.597437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.597687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.597782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.597886] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd280dae-d447-4168-a710-34cbb550aeef is going to be created. [ 1330.622751] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.622907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.622955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.623135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.623282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.631405] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd280dae-d447-4168-a710-34cbb550aeef in Status: UNINITIALIZED for 2s [ 1332.641117] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd280dae-d447-4168-a710-34cbb550aeef in Status: SUCCESS [ 1332.641452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.641499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.641709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.641906] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.642039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.642110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.642259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.642336] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.642423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.642521] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.144579] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.646671] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd280dae-d447-4168-a710-34cbb550aeef: rpc.has_security_group_logging(os_id): False [ 1333.663586] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.663764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.663764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.664061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.664061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.664320] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.664424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.664424] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.664617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.664673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.664751] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd280dae-d447-4168-a710-34cbb550aeef is going to be created. [ 1333.717164] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.717344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.717408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.717645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.717844] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.731026] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd280dae-d447-4168-a710-34cbb550aeef in Status: IN_PROGRESS for 2s [ 1334.081674] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1334.081842] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1334.674892] env[69358]: INFO networking_nsxv3.common.synchronization [None req-6f1f0129-ac5b-4df7-ae50-6eeb1c5be3da None None] Enqueued Resource ID: a9f6f695-93ca-43b0-a541-d30570f7ffc4 with Priority: HIGHEST for action port [ 1334.675308] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f6f695-93ca-43b0-a541-d30570f7ffc4 with Priority: HIGHEST for action port [ 1334.675737] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9f6f695-93ca-43b0-a541-d30570f7ffc4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.675939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9f6f695-93ca-43b0-a541-d30570f7ffc4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.675939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9f6f695-93ca-43b0-a541-d30570f7ffc4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.676384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9f6f695-93ca-43b0-a541-d30570f7ffc4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.676542] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9f6f695-93ca-43b0-a541-d30570f7ffc4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.224818] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9f6f695-93ca-43b0-a541-d30570f7ffc4 [ 1335.224818] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.224818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.224818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.224818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.224818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.224818] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9f6f695-93ca-43b0-a541-d30570f7ffc4 already deleted. [ 1335.224818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9f6f695-93ca-43b0-a541-d30570f7ffc4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.745101] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd280dae-d447-4168-a710-34cbb550aeef in Status: SUCCESS [ 1335.746380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.864422] env[69358]: INFO networking_nsxv3.common.synchronization [None req-15e8e24e-4cf6-46c4-9b9e-af9bff9d76be None None] Enqueued Resource ID: d89c2f17-bf46-4c4b-bb50-19fdf77f713b with Priority: HIGHEST for action port [ 1336.864705] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d89c2f17-bf46-4c4b-bb50-19fdf77f713b with Priority: HIGHEST for action port [ 1336.865308] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-d89c2f17-bf46-4c4b-bb50-19fdf77f713b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.865453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d89c2f17-bf46-4c4b-bb50-19fdf77f713b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.865534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d89c2f17-bf46-4c4b-bb50-19fdf77f713b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.865787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d89c2f17-bf46-4c4b-bb50-19fdf77f713b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.865869] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d89c2f17-bf46-4c4b-bb50-19fdf77f713b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.373056] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d89c2f17-bf46-4c4b-bb50-19fdf77f713b [ 1337.373284] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.373284] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.373467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.373600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.373699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.373795] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d89c2f17-bf46-4c4b-bb50-19fdf77f713b already deleted. [ 1337.373877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d89c2f17-bf46-4c4b-bb50-19fdf77f713b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.512411] env[69358]: INFO networking_nsxv3.common.synchronization [req-377a8b45-6f23-46ba-be02-7edc0826875e req-b7fb778d-831e-495f-b2bb-99a33a63c0c9 tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1338.512833] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1338.513359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.513484] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.513555] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.513753] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.513905] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.514009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.514076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.514222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.514307] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.514410] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.016949] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.016949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.016949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.016949] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.039624] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.039880] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.039998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.040082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.040273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.040357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.040445] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1339.065491] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.065655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.065769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.065924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.066079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.074052] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1341.084342] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1341.084692] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 deletion is rescheduled due to dependency. [ 1341.084692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.534880] env[69358]: INFO networking_nsxv3.common.synchronization [req-02f87b45-2b69-45a7-8f53-6997d7da6e55 req-5c0034d4-db3d-4c9d-85e4-9f9ebfeb1482 tempest-ServersNegativeTestJSON-1924043836 tempest-ServersNegativeTestJSON-1924043836-project-member] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1341.535442] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1341.535753] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.535880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.535941] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.536210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.536363] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.536458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.536514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.536676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.536762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.536854] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.813870] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-216 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.814097] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.814233] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.814553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.814820] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.814985] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.815127] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.815348] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.815498] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.815740] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1341.815864] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1341.815982] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1341.816114] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1341.816257] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1341.816343] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1341.816491] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1341.833017] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1341.833188] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1341.833329] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1341.833494] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.833764] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4c0c6f38-7de6-488d-961d-85c1cfa228f5 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.833929] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.834066] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.834347] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.834490] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c0c6f38-7de6-488d-961d-85c1cfa228f5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.038503] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.038764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.038836] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.039060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.039153] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.039348] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.039445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.039504] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.039639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.039740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.039865] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 already deleted. [ 1342.039954] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.336699] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.337031] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.337079] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.337410] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.337562] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.337766] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 4c0c6f38-7de6-488d-961d-85c1cfa228f5 not found, creating... [ 1342.338042] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.338213] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.338338] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.338570] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.338715] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.339376] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.339559] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.339689] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.339907] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.340058] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.340207] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4c0c6f38-7de6-488d-961d-85c1cfa228f5 is going to be created. [ 1342.358211] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.358408] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.358542] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.358789] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.359015] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.359242] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.039232] env[69358]: INFO networking_nsxv3.common.synchronization [req-02f87b45-2b69-45a7-8f53-6997d7da6e55 req-b43b0cf3-c147-45a1-ac53-7389c3225445 service nova] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_rules [ 1343.039452] env[69358]: INFO networking_nsxv3.common.synchronization [req-02f87b45-2b69-45a7-8f53-6997d7da6e55 req-b43b0cf3-c147-45a1-ac53-7389c3225445 service nova] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1343.039645] env[69358]: INFO networking_nsxv3.common.synchronization [req-02f87b45-2b69-45a7-8f53-6997d7da6e55 req-b43b0cf3-c147-45a1-ac53-7389c3225445 service nova] Enqueued Resource ID: 4c0c6f38-7de6-488d-961d-85c1cfa228f5 with Priority: HIGHEST for action port [ 1343.040069] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_rules [ 1343.040210] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1343.040308] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0c6f38-7de6-488d-961d-85c1cfa228f5 with Priority: HIGHEST for action port [ 1343.040578] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.040704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.040778] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.041196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.041196] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.041857] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.041994] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.042065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.042196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.042566] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.042566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.042566] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.045029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.045029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.045029] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.045029] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c0c6f38-7de6-488d-961d-85c1cfa228f5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.045029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.045405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.045405] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.045405] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c0c6f38-7de6-488d-961d-85c1cfa228f5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.546834] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.547881] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.548046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.548174] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c0c6f38-7de6-488d-961d-85c1cfa228f5 with status ACTIVE [ 1343.548359] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.548464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.548534] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.548763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.548854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.549034] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.549131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.549193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.549339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.549416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.549599] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.549687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.549759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.550297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.550297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.550297] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c0c6f38-7de6-488d-961d-85c1cfa228f5 is going to be updated. [ 1343.570865] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.571026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.571075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.571270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.571365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.571517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.051944] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.553794] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.554222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.554222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.554303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.554404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.554452] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be created. [ 1344.578758] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.579082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.579082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.579748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.579748] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.587806] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: UNINITIALIZED for 2s [ 1346.597603] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1346.598044] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.598102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.598330] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.598556] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.598716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.598808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.599022] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.599134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.599247] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.599344] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.954072] env[69358]: INFO networking_nsxv3.common.synchronization [req-ecedc279-a561-4093-b67a-332380182c61 req-e76b4115-73d6-4e55-80fd-4dd384c04bf2 tempest-DeleteServersTestJSON-1117777682 tempest-DeleteServersTestJSON-1117777682-project-member] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1346.954624] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGHEST for action security_group_members [ 1346.954944] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.955079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.955137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.955334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.955492] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.955588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.955672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.955810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.955896] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.955992] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.102155] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.102414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.102414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.102581] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.102751] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.102850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.102931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.103082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.103176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.103265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.103412] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.103508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.103596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.103752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.103891] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.103985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.104057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.104200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.104277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.104360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.104450] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.459987] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.459987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.459987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.459987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.459987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.459987] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.459987] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.460433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.460433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.460433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.460433] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be updated. [ 1347.487137] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.487303] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.487351] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.487920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.487920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.496571] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: IN_PROGRESS for 2s [ 1347.606309] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db2756cb-20c7-414b-95dc-777acf1f02b2: rpc.has_security_group_logging(os_id): False [ 1347.624266] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.624420] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.624471] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.624705] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.625252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.625252] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.625252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.625252] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.625473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.625473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.625587] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.625681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.625738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.625877] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.625951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.626148] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.626234] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.626295] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.626430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.626515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.626621] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be created. [ 1347.679697] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.679966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.679966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.680188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.680312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.689996] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1349.506408] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b in Status: SUCCESS [ 1349.506408] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b deletion is rescheduled due to dependency. [ 1349.506408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.703183] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1349.703422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.935248] env[69358]: INFO networking_nsxv3.common.synchronization [req-46695278-86cf-4396-8586-b57da737b5a7 req-7b28cb2e-ea9d-422b-9bc9-35726ee6ba92 tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1349.935776] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1349.936099] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.936215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.936283] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.936522] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.936621] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.936714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.936774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.936913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.937025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.937301] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.183635] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.183850] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.183984] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.184280] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.184540] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.184703] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.185177] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.185490] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.185597] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.185822] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1350.185943] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1350.189572] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1350.189572] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1350.189572] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1350.189572] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1350.189572] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1350.212584] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1350.212766] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1350.212914] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1350.213110] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.213438] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-ad90a17c-c5a3-4842-a345-3befe4b85d18 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.213617] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-ad90a17c-c5a3-4842-a345-3befe4b85d18" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.213747] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-ad90a17c-c5a3-4842-a345-3befe4b85d18" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.214107] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-ad90a17c-c5a3-4842-a345-3befe4b85d18" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.214322] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad90a17c-c5a3-4842-a345-3befe4b85d18',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.439618] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.439807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.439876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.440084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.440184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.440386] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.440488] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.440551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.440702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.440781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.440869] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1350.468684] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.468848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.468848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.469038] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.469173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.477391] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1350.717060] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.717060] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.717060] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.717551] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.717551] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.717699] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port ad90a17c-c5a3-4842-a345-3befe4b85d18 not found, creating... [ 1350.717920] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.718133] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.718262] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.718548] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.718708] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.719015] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.719186] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.719315] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.719568] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.719713] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.719863] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: ad90a17c-c5a3-4842-a345-3befe4b85d18 is going to be created. [ 1350.741137] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.741336] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.741465] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.741738] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.741974] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.742244] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-ad90a17c-c5a3-4842-a345-3befe4b85d18" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.400057] env[69358]: INFO networking_nsxv3.common.synchronization [req-46695278-86cf-4396-8586-b57da737b5a7 req-7bae88e4-dbea-496a-83b7-60a985e906cd service nova] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1351.400233] env[69358]: INFO networking_nsxv3.common.synchronization [req-46695278-86cf-4396-8586-b57da737b5a7 req-7bae88e4-dbea-496a-83b7-60a985e906cd service nova] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1351.400445] env[69358]: INFO networking_nsxv3.common.synchronization [req-46695278-86cf-4396-8586-b57da737b5a7 req-7bae88e4-dbea-496a-83b7-60a985e906cd service nova] Enqueued Resource ID: ad90a17c-c5a3-4842-a345-3befe4b85d18 with Priority: HIGHEST for action port [ 1351.400762] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1351.400928] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1351.401049] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad90a17c-c5a3-4842-a345-3befe4b85d18 with Priority: HIGHEST for action port [ 1351.401610] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.401871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.401970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.402229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.402333] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.403571] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.403683] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.403920] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad90a17c-c5a3-4842-a345-3befe4b85d18 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.404035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad90a17c-c5a3-4842-a345-3befe4b85d18" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.404102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad90a17c-c5a3-4842-a345-3befe4b85d18" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.404313] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad90a17c-c5a3-4842-a345-3befe4b85d18" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.404419] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad90a17c-c5a3-4842-a345-3befe4b85d18',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.906441] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.906862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.906862] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad90a17c-c5a3-4842-a345-3befe4b85d18 with status ACTIVE [ 1351.906966] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.907096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.907178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.907406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.907557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.907822] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.907822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.907932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.907989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.908086] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.908286] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.908375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.908437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.908568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.908665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.908744] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad90a17c-c5a3-4842-a345-3befe4b85d18 is going to be updated. [ 1351.936977] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.937164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.937164] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.937353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.937483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.937722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad90a17c-c5a3-4842-a345-3befe4b85d18" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.486912] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1352.487156] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 deletion is rescheduled due to dependency. [ 1352.487274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.487432] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.487702] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.487896] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.488017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.488085] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.488242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.488324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.488418] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.991327] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.493547] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.995752] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.996138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.996138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.996272] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.996377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.996492] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1354.027638] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.027831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.027886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.028115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.028282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.036797] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1354.705118] env[69358]: INFO networking_nsxv3.common.synchronization [req-ee03a723-d0f4-4ccc-beb2-327be928a1a8 req-0dd33787-cdb6-45f4-92bc-b8e9b7900837 tempest-ServersNegativeTestJSON-1924043836 tempest-ServersNegativeTestJSON-1924043836-project-member] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1354.705118] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1354.705118] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.705118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.705118] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.705998] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.706425] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.706717] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.706963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.707236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.707414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.707609] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.213818] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.243498] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-216 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.243717] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.243848] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.244147] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.244407] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.244571] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.244692] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.244925] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.245863] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.246142] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.246277] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1355.246410] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1355.246557] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1355.246688] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.246804] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1355.246994] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1355.267256] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1355.267484] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1355.267690] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1355.267798] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.268132] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.268323] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.268450] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.268816] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.268966] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b707609-c71c-4ca3-be9f-c1d5c49aac1f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.717089] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.771096] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.771356] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.771474] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.771753] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.771910] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.772084] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 4b707609-c71c-4ca3-be9f-c1d5c49aac1f not found, creating... [ 1355.772379] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.772557] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.772683] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.772972] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.773145] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.773436] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.773599] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.773722] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.773988] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.774182] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.774340] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4b707609-c71c-4ca3-be9f-c1d5c49aac1f is going to be created. [ 1355.793239] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.793413] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.793543] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.793772] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.793991] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.794224] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.046582] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1356.046788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.046950] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.047182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.047365] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.047483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.047550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.047737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.047848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.047890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.047986] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.219065] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.219362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.219362] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.219623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.219775] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.219944] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be updated. [ 1356.245078] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.245184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.245228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.245419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.245557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.253884] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1356.472020] env[69358]: INFO networking_nsxv3.common.synchronization [req-ee03a723-d0f4-4ccc-beb2-327be928a1a8 req-d3d4bc53-8c3d-4caf-83d3-e055a1029245 service nova] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_rules [ 1356.472020] env[69358]: INFO networking_nsxv3.common.synchronization [req-ee03a723-d0f4-4ccc-beb2-327be928a1a8 req-d3d4bc53-8c3d-4caf-83d3-e055a1029245 service nova] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1356.472020] env[69358]: INFO networking_nsxv3.common.synchronization [req-ee03a723-d0f4-4ccc-beb2-327be928a1a8 req-d3d4bc53-8c3d-4caf-83d3-e055a1029245 service nova] Enqueued Resource ID: 4b707609-c71c-4ca3-be9f-c1d5c49aac1f with Priority: HIGHEST for action port [ 1356.472020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_rules [ 1356.472020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1356.472020] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b707609-c71c-4ca3-be9f-c1d5c49aac1f with Priority: HIGHEST for action port [ 1356.472020] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.472020] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.472567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.472912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.473739] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.474084] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.474242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.474516] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.474673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.474859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.475143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.475253] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b707609-c71c-4ca3-be9f-c1d5c49aac1f',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.550294] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.977376] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.977604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.978046] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b707609-c71c-4ca3-be9f-c1d5c49aac1f with status ACTIVE [ 1356.978046] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.978046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.978190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.978298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.978387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.978557] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.978670] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.978749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.978865] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.978943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.979135] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.979228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.979290] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.979427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.979498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.979581] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b707609-c71c-4ca3-be9f-c1d5c49aac1f is going to be updated. [ 1356.999679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.999871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.999871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.000107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.000238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.000392] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b707609-c71c-4ca3-be9f-c1d5c49aac1f" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.053074] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70627b51-3375-41aa-82f3-78ff340110c2: rpc.has_security_group_logging(os_id): False [ 1357.071937] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.072160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.072160] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.072356] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.072458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.072803] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.072984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.072984] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.073182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.073281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.073349] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1357.174835] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.175014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.175065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.175269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.175409] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.196825] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1358.263804] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1358.264335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.264335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.264477] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.264621] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.264781] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.264879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.265054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.265185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.265297] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.768233] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.210674] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1359.210861] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.270413] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.773016] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.773198] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.773270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.773498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.773597] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.773764] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be updated. [ 1359.800907] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.801102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.801182] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.801451] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.801620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.812153] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1361.472266] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.472660] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1361.823072] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1361.823298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.823459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.823676] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.823865] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.823980] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.824068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.824206] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.824297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.824389] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.824506] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.326758] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.326955] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.327029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.327240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.327417] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.327519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.327582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.327770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.327859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.327952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.328113] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.328209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.328270] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.328411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.328546] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.328637] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.328712] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.328859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.328933] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.329027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.329121] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.831935] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db2756cb-20c7-414b-95dc-777acf1f02b2: rpc.has_security_group_logging(os_id): False [ 1362.851673] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.851883] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.851935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.852176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.852269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.852491] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.852593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.852655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.852803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.852880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.853074] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.853167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.853227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.853368] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.853437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.853623] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.853714] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.853773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.853907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.853979] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.854074] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be updated. [ 1362.910300] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.910511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.910511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.910737] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.910885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.923684] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1364.938881] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1364.939314] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.473298] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.473649] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.744721] env[69358]: INFO networking_nsxv3.common.synchronization [req-be765dbf-b730-4b0b-80e8-26d0d539eb51 req-af3fb4c5-dcbb-4e6e-b510-1b3039cf0611 tempest-ServersNegativeTestJSON-1924043836 tempest-ServersNegativeTestJSON-1924043836-project-member] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1366.744829] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1366.745841] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.745962] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.746031] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.746225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.746414] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.746503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.746560] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.746677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.746752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.746851] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.251299] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.753900] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.256531] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.256732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.256796] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.256970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.257093] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.257217] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be updated. [ 1368.286240] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.286375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.286456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.286642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.286817] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.295813] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1370.306499] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1370.306790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.747022] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.747378] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.748191] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.748546] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.474030] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.474030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.474030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.474030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.474030] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.975401] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.478013] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.749706] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.749895] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.980041] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1381.980188] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1382.666302] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.666302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.666302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.666829] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.679333] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1382.680175] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.680813] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1382.714408] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.714537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.714621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.714793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.727030] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.727718] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1382.727802] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1382.727912] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1382.761796] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.762010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.762090] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.762273] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.763385] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.763571] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1382.835643] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.835867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.835943] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.836181] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.836518] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.836825] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1382.900411] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.900686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.900686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.900809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.901112] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.901394] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1382.901488] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1ab11f00-3987-4b05-b006-d9576475f847', 'ad508364-f300-40f8-9b87-0edcdb3c9125', '3790264b-87dd-4660-b7c5-8d4dc98f1500', '6bcbfacc-e75b-4ac4-81ab-350530d27ada', 'c5b54a11-30a4-4b59-9e2e-3429b26a65f9', 'cd280dae-d447-4168-a710-34cbb550aeef', '012ec087-a6ab-4c42-83a0-58a518f9a415', 'db2756cb-20c7-414b-95dc-777acf1f02b2', '51af08cc-9a30-4dff-8fb1-ae75e324301c', '32b12b9f-791a-4b1b-a31c-2e597d81d82d', '70627b51-3375-41aa-82f3-78ff340110c2', '5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a', '9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b', '92e0950b-cead-448f-83c8-f0567e5a19e2', '0c59601c-f6bf-486f-a60f-b19e02c39dbe', 'e0f3175f-70d6-4954-936f-524f7ca25a4b', 'a63445e5-d5fa-4b5f-aefd-36f6c4ad7252', '4335c702-c854-428a-bca2-25e63a950287', 'b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770', '4ea3bd4d-789d-41ef-b939-e3909d5d52e9', 'b8ab349f-7df0-40a9-a595-1a8e298f956a', '0e7da1ca-32ca-4463-86e0-e62b1a908a4a', '9495602c-f01c-4935-941b-dacd2d1ea667', '193bc791-0b82-49f5-a278-c6f34ab0eaf3', '1eb445c3-23e7-4fd9-a847-f86f9e461f64', 'e9b439f6-daaf-4792-b3c7-d618e26ce5f4', 'd18a7451-b9c3-48be-82ef-e20729d3779a', 'd904f37a-b3f7-4aef-9721-265081cb343b', 'b2c85ab1-5f4b-4878-9858-c616793b3b32', '1426a21d-d3c6-4fed-bbe0-ee2b64373b73', '32d20126-9c39-42b2-acda-4aa519da54c6', 'a1e4e649-079d-4cd0-98f4-699005461275', '75c45f18-eee4-4639-b07a-413cc1624dbc', '46002bc2-9685-44d1-a0f5-f9a4ebc7e375', '98a5293d-e48e-493b-ac38-3a76cc74a5db', 'fd2c3b18-33a0-460a-a199-3124440c68e8', 'b755d42e-d250-4f75-9179-3ef054a079c6', 'ca6990b0-078a-4815-9003-99ea585a4222', '662b0a83-6546-43c9-93f7-23997583fecf', '3c21f0b2-3055-4df5-9afa-fd29cf1279d5', 'b753fa61-5f01-4b27-9adf-adec33a7b29e'} {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1382.901600] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1382.933736] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.933970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.933970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.934159] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.934245] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.934356] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1382.934433] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1382.934545] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1383.011482] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.011666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.011725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.011887] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.012978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.013233] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1383.013317] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1383.013379] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1383.013443] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1383.013514] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1383.013584] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGH for action security_group_rules [ 1383.013662] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGH for action security_group_rules [ 1383.013727] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGH for action security_group_rules [ 1383.013787] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGH for action security_group_rules [ 1383.013846] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGH for action security_group_rules [ 1383.013901] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGH for action security_group_rules [ 1383.013955] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGH for action security_group_rules [ 1383.014019] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGH for action security_group_rules [ 1383.014075] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGH for action security_group_rules [ 1383.014140] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGH for action security_group_rules [ 1383.014191] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGH for action security_group_rules [ 1383.014243] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGH for action security_group_rules [ 1383.014299] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGH for action security_group_rules [ 1383.014356] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGH for action security_group_rules [ 1383.014411] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGH for action security_group_rules [ 1383.014474] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGH for action security_group_rules [ 1383.014533] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGH for action security_group_rules [ 1383.014589] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGH for action security_group_rules [ 1383.014649] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGH for action security_group_rules [ 1383.014707] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGH for action security_group_rules [ 1383.014799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.516077] env[69358]: INFO networking_nsxv3.common.synchronization [None req-c3488e7c-2371-4694-b183-9a80bb487a58 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_rules [ 1384.516748] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_rules [ 1384.516920] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab11f00-3987-4b05-b006-d9576475f847 with Priority: HIGH for action security_group_rules [ 1384.517044] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 with Priority: HIGH for action security_group_rules [ 1384.517147] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 with Priority: HIGH for action security_group_rules [ 1384.517244] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe with Priority: HIGH for action security_group_rules [ 1384.517338] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 with Priority: HIGH for action security_group_rules [ 1384.517636] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 with Priority: HIGH for action security_group_rules [ 1384.517636] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4335c702-c854-428a-bca2-25e63a950287 with Priority: HIGH for action security_group_rules [ 1384.517636] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 with Priority: HIGH for action security_group_rules [ 1384.517836] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 with Priority: HIGH for action security_group_rules [ 1384.517836] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f3175f-70d6-4954-936f-524f7ca25a4b with Priority: HIGH for action security_group_rules [ 1384.517981] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b with Priority: HIGH for action security_group_rules [ 1384.517981] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a with Priority: HIGH for action security_group_rules [ 1384.518109] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGH for action security_group_rules [ 1384.518261] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d with Priority: HIGH for action security_group_rules [ 1384.518261] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c with Priority: HIGH for action security_group_rules [ 1384.518363] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGH for action security_group_rules [ 1384.518363] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGH for action security_group_rules [ 1384.518467] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 with Priority: HIGH for action security_group_rules [ 1384.518533] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad508364-f300-40f8-9b87-0edcdb3c9125 with Priority: HIGH for action security_group_rules [ 1384.518720] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada with Priority: HIGH for action security_group_rules [ 1384.518913] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71b98808-4982-4022-a948-dbfdb245f026 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.519045] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.519242] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.519361] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.519433] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.520253] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab11f00-3987-4b05-b006-d9576475f847 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.520366] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.520446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.520613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.520692] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab11f00-3987-4b05-b006-d9576475f847',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.521446] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3790264b-87dd-4660-b7c5-8d4dc98f1500 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.521556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.521622] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.521771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.521838] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3790264b-87dd-4660-b7c5-8d4dc98f1500',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.522761] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-012ec087-a6ab-4c42-83a0-58a518f9a415 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.522872] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.522932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.523101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.523172] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('012ec087-a6ab-4c42-83a0-58a518f9a415',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.523843] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.523952] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.524033] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.524238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.524310] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c59601c-f6bf-486f-a60f-b19e02c39dbe',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.525027] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.525169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.525225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.525355] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.525424] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ea3bd4d-789d-41ef-b939-e3909d5d52e9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.526119] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.526215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.526281] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.526421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.526492] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.527466] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4335c702-c854-428a-bca2-25e63a950287 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.527572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.527636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.527784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.527870] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4335c702-c854-428a-bca2-25e63a950287',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.528546] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.528852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.528852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.528852] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.529055] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a63445e5-d5fa-4b5f-aefd-36f6c4ad7252',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.529617] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92e0950b-cead-448f-83c8-f0567e5a19e2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.529761] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.529810] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.529966] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.530042] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92e0950b-cead-448f-83c8-f0567e5a19e2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.530708] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0f3175f-70d6-4954-936f-524f7ca25a4b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.530818] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.530879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.531028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.531104] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0f3175f-70d6-4954-936f-524f7ca25a4b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.531871] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.532058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.532058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.532199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.532258] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.532920] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.533057] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.533169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.533250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.533335] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.534162] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.534162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.534162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.534357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.534357] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.536703] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.537035] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.537166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.537388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.537506] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32b12b9f-791a-4b1b-a31c-2e597d81d82d',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.538220] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51af08cc-9a30-4dff-8fb1-ae75e324301c taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.538325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.538422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.538532] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.538605] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51af08cc-9a30-4dff-8fb1-ae75e324301c',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.539338] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.539441] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.539505] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.539655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.539728] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.540506] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.540615] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.540681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.540835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.540905] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.541953] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.542049] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.542095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.542238] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.542336] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5b54a11-30a4-4b59-9e2e-3429b26a65f9',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.542968] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad508364-f300-40f8-9b87-0edcdb3c9125 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.543079] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.543141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.543288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.543360] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad508364-f300-40f8-9b87-0edcdb3c9125',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.544015] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.544133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.544200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.544413] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.544459] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bcbfacc-e75b-4ac4-81ab-350530d27ada',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.568146] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.568324] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.568377] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.568539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.585028] env[69358]: INFO networking_nsxv3.common.synchronization [None req-af0b1d84-904c-4010-8bbb-a4d43d00086c tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_rules [ 1384.585486] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_rules [ 1384.586447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.586554] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a63445e5-d5fa-4b5f-aefd-36f6c4ad7252 is going to be deleted. [ 1384.587572] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71b98808-4982-4022-a948-dbfdb245f026 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.587674] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.631793] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.631971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.632052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.632264] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.632353] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.632470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a63445e5-d5fa-4b5f-aefd-36f6c4ad7252" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.047550] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.047758] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.047880] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.048209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.048677] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.048677] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.048784] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.048921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.049084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.049228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.049364] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.059044] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.059167] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.059222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.059390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.059539] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.059634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.059696] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.060384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.060480] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.060570] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.060658] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.063995] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.064132] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.064196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.064354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.064501] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.064596] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.064716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.064795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.065440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.065440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.065440] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.109960] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.110184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.110184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.110372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.115434] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.115573] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.116247] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.116344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.124450] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.124556] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.125591] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.125681] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.127211] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.127287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.128025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.128115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.128808] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.128913] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.129600] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.129722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.130361] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.130449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.131136] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.131229] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.131794] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1385.132188] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.132280] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.132833] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1385.133197] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.133288] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.133835] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1385.134208] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.134316] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.134886] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1385.135264] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.135375] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.135948] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1385.136334] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.136425] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.137260] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1385.137620] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.137715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.138342] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1385.138710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.138818] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51af08cc-9a30-4dff-8fb1-ae75e324301c is going to be deleted. [ 1385.139633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.139828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.139915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.140013] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71b98808-4982-4022-a948-dbfdb245f026 already deleted. [ 1385.140102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.140249] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.140398] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.141162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.141323] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.141406] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.158435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.158542] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5b54a11-30a4-4b59-9e2e-3429b26a65f9 is going to be deleted. [ 1385.159333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.159508] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.174803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.174913] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ea3bd4d-789d-41ef-b939-e3909d5d52e9 is going to be deleted. [ 1385.175619] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.175790] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.191674] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.191806] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.194969] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.195096] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab11f00-3987-4b05-b006-d9576475f847 is going to be deleted. [ 1385.195819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.195999] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.221527] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.221653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.224618] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.224709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.275116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.275265] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c59601c-f6bf-486f-a60f-b19e02c39dbe is going to be deleted. [ 1385.276213] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.276437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.339373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.339523] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b is going to be deleted. [ 1385.340446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.340669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.342114] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.342222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.379442] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.379554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.383762] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.383883] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0f3175f-70d6-4954-936f-524f7ca25a4b is going to be deleted. [ 1385.384701] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.384906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.447133] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.447272] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 012ec087-a6ab-4c42-83a0-58a518f9a415 is going to be deleted. [ 1385.448142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.448348] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.494665] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.494815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.534340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.534639] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a is going to be deleted. [ 1385.535236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.535434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.536663] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.537567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.554090] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.579025] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.579176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.579277] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.579498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.579662] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.579766] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.579831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.579978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.580076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.580162] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.580306] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.580396] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.580457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.580592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.580726] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.580828] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.580899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.581062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.581141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.581222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.581308] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.582425] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.610151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.610281] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770 is going to be deleted. [ 1385.611105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.611297] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.654959] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.655134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.669434] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.669606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.674436] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.674556] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3790264b-87dd-4660-b7c5-8d4dc98f1500 is going to be deleted. [ 1385.675605] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.676080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.692378] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.692521] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.724421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.724520] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad508364-f300-40f8-9b87-0edcdb3c9125 is going to be deleted. [ 1385.725301] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.725501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.784509] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.784647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.786760] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.786871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.809422] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.809510] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bcbfacc-e75b-4ac4-81ab-350530d27ada is going to be deleted. [ 1385.810210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.810410] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.894589] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.894721] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92e0950b-cead-448f-83c8-f0567e5a19e2 is going to be deleted. [ 1385.895650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.895853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.927917] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.928103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.989482] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.989673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.991509] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.991634] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4335c702-c854-428a-bca2-25e63a950287 is going to be deleted. [ 1385.992601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.992809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.033634] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.033754] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32b12b9f-791a-4b1b-a31c-2e597d81d82d is going to be deleted. [ 1386.034498] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.034687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.034774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.034895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51af08cc-9a30-4dff-8fb1-ae75e324301c" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.035070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.035224] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.035304] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.035411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5b54a11-30a4-4b59-9e2e-3429b26a65f9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.035889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.036077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.036165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.036285] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ea3bd4d-789d-41ef-b939-e3909d5d52e9" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.036416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.036562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.036639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.036751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab11f00-3987-4b05-b006-d9576475f847" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.036875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.037021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.037101] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.037210] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c59601c-f6bf-486f-a60f-b19e02c39dbe" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.037333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.037470] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.037545] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.037651] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd5c4be-c0b7-44a0-b308-cc25d2ffee1b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.037772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.037928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.038014] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.038134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0f3175f-70d6-4954-936f-524f7ca25a4b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.038257] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.038419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.038495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.038604] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-012ec087-a6ab-4c42-83a0-58a518f9a415" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.038729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.039169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.039169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.039169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ea8816f-29ff-4b2a-a6cb-e6b6e6555a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.039169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.039343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.039343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.039475] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71b98808-4982-4022-a948-dbfdb245f026 already deleted. [ 1386.039515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.039621] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.039756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.039884] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.039935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b66e30e7-b3e4-4a0a-8b60-0f0cfb6af770" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.040490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.040490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.040490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.040490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3790264b-87dd-4660-b7c5-8d4dc98f1500" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.040490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.040727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.040727] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.040799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bcbfacc-e75b-4ac4-81ab-350530d27ada" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.040856] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.040989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.041071] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.041176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad508364-f300-40f8-9b87-0edcdb3c9125" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.055509] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd280dae-d447-4168-a710-34cbb550aeef: rpc.has_security_group_logging(os_id): False [ 1386.084225] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db2756cb-20c7-414b-95dc-777acf1f02b2: rpc.has_security_group_logging(os_id): False [ 1386.085652] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70627b51-3375-41aa-82f3-78ff340110c2: rpc.has_security_group_logging(os_id): False [ 1386.131934] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.132142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.132142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.132315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.134011] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.134122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.134841] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.134938] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.135658] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.135767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.170503] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.170653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.177129] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.177355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.177459] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.177529] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.177703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.177782] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.178011] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.178109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.178166] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.178311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.178386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.178573] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.178652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.178710] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.178891] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.178973] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.179087] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be updated. [ 1386.179967] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.180143] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.180226] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.180337] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92e0950b-cead-448f-83c8-f0567e5a19e2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.180460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.180600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.218308] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.218419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.233638] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.233868] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.233957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.234025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.234185] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.234263] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.234353] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd280dae-d447-4168-a710-34cbb550aeef is going to be updated. [ 1386.235218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.235381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.235465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.235582] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4335c702-c854-428a-bca2-25e63a950287" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.235704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.235892] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.278779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.279061] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.279170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.279223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.279384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.279464] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.279546] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1386.280416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.280577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.280660] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.280770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32b12b9f-791a-4b1b-a31c-2e597d81d82d" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.360054] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.360054] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.360341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.360341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.360408] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.387826] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1386.418568] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.418700] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.418744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.418915] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.419092] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.427908] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.428062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.428135] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.428308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.428438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.432527] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd280dae-d447-4168-a710-34cbb550aeef in Status: IN_PROGRESS for 2s [ 1386.442052] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1388.401664] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1388.402051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.442869] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd280dae-d447-4168-a710-34cbb550aeef in Status: SUCCESS [ 1388.443104] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.451774] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1388.451948] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.586525] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.586871] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.824159] env[69358]: INFO networking_nsxv3.common.synchronization [req-576d6c66-76c8-4692-9988-ffad7348ea52 req-c8a4c133-66a9-48d0-9f22-107ea9eeed31 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_members [ 1389.824159] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_members [ 1389.824668] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-71b98808-4982-4022-a948-dbfdb245f026 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.824668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.824668] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.824823] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.824963] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.825449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.825519] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.825673] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.825754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.825849] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.109271] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.109466] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.110048] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.110048] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.110216] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.110304] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.110434] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.110860] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.111038] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.111261] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.111378] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1390.111489] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1390.111599] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1390.111709] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.111816] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1390.111951] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1390.130526] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1390.130716] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1390.130959] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1390.131253] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.131838] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.132038] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.132303] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.132518] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.132668] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b66f7c6-0332-4bcd-98ee-a228e3f6c998',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.328018] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.328018] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.328386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.328435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.328562] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.328773] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.329042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.329042] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.329173] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.329228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.329281] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71b98808-4982-4022-a948-dbfdb245f026 already deleted. [ 1390.329349] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.635029] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.635447] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.635447] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.635535] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.635692] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.635910] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 1b66f7c6-0332-4bcd-98ee-a228e3f6c998 not found, creating... [ 1390.636240] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.636431] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.636565] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.636815] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.636977] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.637308] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.637484] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.637625] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.637857] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.638054] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.638214] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 1b66f7c6-0332-4bcd-98ee-a228e3f6c998 is going to be created. [ 1390.656850] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.657108] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.657276] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.657502] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.657740] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.657999] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.334340] env[69358]: INFO networking_nsxv3.common.synchronization [req-576d6c66-76c8-4692-9988-ffad7348ea52 req-98ef382e-97bc-4c00-b9e3-16a78770ba9e service nova] Enqueued Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_rules [ 1391.334531] env[69358]: INFO networking_nsxv3.common.synchronization [req-576d6c66-76c8-4692-9988-ffad7348ea52 req-98ef382e-97bc-4c00-b9e3-16a78770ba9e service nova] Enqueued Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_members [ 1391.334672] env[69358]: INFO networking_nsxv3.common.synchronization [req-576d6c66-76c8-4692-9988-ffad7348ea52 req-98ef382e-97bc-4c00-b9e3-16a78770ba9e service nova] Enqueued Resource ID: 1b66f7c6-0332-4bcd-98ee-a228e3f6c998 with Priority: HIGHEST for action port [ 1391.334904] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_rules [ 1391.335050] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_members [ 1391.335154] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b66f7c6-0332-4bcd-98ee-a228e3f6c998 with Priority: HIGHEST for action port [ 1391.335730] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71b98808-4982-4022-a948-dbfdb245f026 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.335808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.335878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.336096] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.336178] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.336954] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-71b98808-4982-4022-a948-dbfdb245f026 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.337082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.337149] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.337312] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.337456] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.337546] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.337606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.337741] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.337826] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.337910] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.338945] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.339082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.339176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.340025] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.340130] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b66f7c6-0332-4bcd-98ee-a228e3f6c998',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.842423] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.842682] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-71b98808-4982-4022-a948-dbfdb245f026 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.842754] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.843367] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b66f7c6-0332-4bcd-98ee-a228e3f6c998 with status ACTIVE [ 1391.843367] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.843367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.843367] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.843801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.843801] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.843801] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.843970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.843970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.844091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.844190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.844362] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.844465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.844537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.844667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.844759] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.844846] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b66f7c6-0332-4bcd-98ee-a228e3f6c998 is going to be updated. [ 1391.868861] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.869230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.869230] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.869380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.869533] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.869715] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b66f7c6-0332-4bcd-98ee-a228e3f6c998" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.347044] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.850121] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.850692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.850692] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.850835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.850901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.851389] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71b98808-4982-4022-a948-dbfdb245f026 is going to be created. [ 1392.876058] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.876058] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.876335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.876335] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.876473] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.885435] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71b98808-4982-4022-a948-dbfdb245f026 in Status: UNINITIALIZED for 2s [ 1394.896338] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71b98808-4982-4022-a948-dbfdb245f026 in Status: SUCCESS [ 1394.896795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.896795] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.897026] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.897250] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.897404] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.897495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.897667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.897769] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.897881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.898028] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.400947] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.903298] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71b98808-4982-4022-a948-dbfdb245f026: rpc.has_security_group_logging(os_id): False [ 1395.921416] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.921653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.921653] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.921809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.921888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.922154] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.922275] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.922333] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.922465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.922553] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.922625] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71b98808-4982-4022-a948-dbfdb245f026 is going to be created. [ 1395.982346] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.982636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.982636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.982850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.983043] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.993034] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71b98808-4982-4022-a948-dbfdb245f026 in Status: IN_PROGRESS for 2s [ 1396.336094] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.336307] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1398.006313] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71b98808-4982-4022-a948-dbfdb245f026 in Status: SUCCESS [ 1398.006667] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.336930] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.337212] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.337795] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.338177] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.613395] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-216 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.613689] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.613689] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.613798] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.614066] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.614233] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.614354] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.614564] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.614709] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.614921] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1409.615046] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1409.615160] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1409.615273] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1409.615385] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1409.615492] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1409.615629] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1409.633966] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1409.634194] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1409.634340] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1409.634518] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-216" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.634827] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-4c0c6f38-7de6-488d-961d-85c1cfa228f5 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.634998] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.635141] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.635386] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.635525] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c0c6f38-7de6-488d-961d-85c1cfa228f5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.138090] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.138382] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.138478] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.138773] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.138930] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.139277] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.139448] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.139575] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.139799] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.139941] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.140248] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.140410] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.140532] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.140741] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.140876] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.141036] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 4c0c6f38-7de6-488d-961d-85c1cfa228f5 is going to be updated. [ 1410.161647] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.161863] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.161938] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.162176] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.162362] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.162566] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.913072] env[69358]: INFO networking_nsxv3.common.synchronization [req-926d55e0-ed72-4584-a615-27c4431bd471 req-d6f9dcca-b76c-4e5d-b1ed-f74c7b9e99e4 service nova] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_rules [ 1410.913372] env[69358]: INFO networking_nsxv3.common.synchronization [req-926d55e0-ed72-4584-a615-27c4431bd471 req-d6f9dcca-b76c-4e5d-b1ed-f74c7b9e99e4 service nova] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1410.913468] env[69358]: INFO networking_nsxv3.common.synchronization [req-926d55e0-ed72-4584-a615-27c4431bd471 req-d6f9dcca-b76c-4e5d-b1ed-f74c7b9e99e4 service nova] Enqueued Resource ID: 4c0c6f38-7de6-488d-961d-85c1cfa228f5 with Priority: HIGHEST for action port [ 1410.913759] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_rules [ 1410.913916] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1410.914035] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0c6f38-7de6-488d-961d-85c1cfa228f5 with Priority: HIGHEST for action port [ 1410.914564] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.914689] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.914757] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.914957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.915129] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.916040] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.916250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.916384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.916642] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.916887] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.917067] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.917138] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.917298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.917411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.917544] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.918324] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c0c6f38-7de6-488d-961d-85c1cfa228f5 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.918495] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.918632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.918851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.918929] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c0c6f38-7de6-488d-961d-85c1cfa228f5',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.420423] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.420649] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.420760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c0c6f38-7de6-488d-961d-85c1cfa228f5 with status ACTIVE [ 1411.420939] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.421066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.421142] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.421359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.421447] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.421619] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.421716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.421779] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.421924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.422009] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.422199] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.422306] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.422380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.422524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.422600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.422684] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c0c6f38-7de6-488d-961d-85c1cfa228f5 is going to be updated. [ 1411.423754] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.443155] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.443300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.443300] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.443468] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.443592] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.443740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c0c6f38-7de6-488d-961d-85c1cfa228f5" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.925798] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.429128] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.429128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.429128] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.429440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.429440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.429440] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be updated. [ 1412.458621] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.458847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.458847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.459066] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.459219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.471580] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1414.481371] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1414.481761] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.481761] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.481988] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.482223] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.482412] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.482506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.482704] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.482814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.482927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.483048] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.985369] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.985598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.985598] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.985750] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.985934] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.986052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.986110] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.986299] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.986378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.986465] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.986609] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.986703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.986798] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.986907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.987055] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.987145] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.987207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.987343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.987417] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.987499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.987587] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.489729] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db2756cb-20c7-414b-95dc-777acf1f02b2: rpc.has_security_group_logging(os_id): False [ 1415.506023] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.506298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.506397] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.506568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.506666] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.506934] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.507082] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.507151] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.507373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.507373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.507591] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.507709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.507709] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.507888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.507888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.508104] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.508309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.508379] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.508524] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.508597] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.508681] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be updated. [ 1415.561965] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.562183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.562183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.562357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.562483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.577770] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1415.915091] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.915281] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1417.594760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1417.594760] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.916222] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.916589] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.917297] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.917644] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.263799] env[69358]: INFO networking_nsxv3.common.synchronization [req-c3ecfb63-7f44-42bf-b54e-4f389f40efc8 req-5251638d-918d-4ca2-aa1d-c9b7d1ddb53d tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1430.264349] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1430.264659] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.264783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.264853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.265100] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.265261] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.266141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.266141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.266141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.266141] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.266141] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.768244] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.768469] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.768579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.768739] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.768840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.769046] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.769152] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.769225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.769372] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.769452] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.769540] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1430.797176] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.797359] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.797433] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.797586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.797723] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.805430] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1432.815264] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1432.815617] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 deletion is rescheduled due to dependency. [ 1432.815617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.265119] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.265349] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.707594] env[69358]: INFO networking_nsxv3.common.synchronization [req-0cc00064-5249-4f89-ae98-1b6099383e7c req-6156a30d-0bb0-470c-9f90-eb778d88f553 tempest-ServersNegativeTestJSON-1924043836 tempest-ServersNegativeTestJSON-1924043836-project-member] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1436.708102] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGHEST for action security_group_members [ 1436.708428] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.708564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.708633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.708816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.708970] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.709117] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.709169] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.709442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.709525] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.709646] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.143283] env[69358]: INFO networking_nsxv3.common.synchronization [req-a57cacd6-b3d5-49ce-9b5c-b550041f1b28 req-67df47e9-992c-4081-9c23-d784aaf9b6a4 tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1437.143858] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1437.144221] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.144371] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.144458] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.144675] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.144838] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.144939] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.145008] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.145196] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.145302] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.145401] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.212675] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.212824] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.212886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.213116] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.213211] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.213483] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.213483] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.213640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.213682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.213749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.213836] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be updated. [ 1437.242452] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.242587] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.242648] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.242840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.242972] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.251059] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: IN_PROGRESS for 2s [ 1437.434183] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.434395] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.434527] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.434795] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.435063] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.435224] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.435344] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.435555] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.435735] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.435986] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1437.436118] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1437.436232] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1437.436369] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1437.436494] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1437.436607] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1437.436743] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1437.454193] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1437.454336] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1437.454474] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1437.454635] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-230" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.454909] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.455089] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.455216] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.455497] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.455636] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.647847] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.647847] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.648069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.648122] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.648217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.648449] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.648549] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.648620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.648772] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.648850] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.648935] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1437.673828] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.673985] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.674068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.674289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.674467] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.682311] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1437.957954] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.958268] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.958355] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.958676] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.958832] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.958992] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7 not found, creating... [ 1437.959271] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.959442] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.959561] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.959786] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.959923] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.960219] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.960378] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.960499] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.960708] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.960844] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.960987] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7 is going to be created. [ 1437.979225] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.979423] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.979553] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.979782] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.979997] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.980225] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.387788] env[69358]: INFO networking_nsxv3.common.synchronization [req-f8bd6c24-1a1f-4be8-8345-42175789c5b2 req-e187ddcc-e7af-4210-8ae5-2e38e3be77bd tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_members [ 1438.388316] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGHEST for action security_group_members [ 1438.388690] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-71b98808-4982-4022-a948-dbfdb245f026 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.388816] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.388885] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.389095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.389243] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.389342] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.389406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.389568] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.389682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.389765] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.701436] env[69358]: INFO networking_nsxv3.common.synchronization [req-a57cacd6-b3d5-49ce-9b5c-b550041f1b28 req-2e0d3525-9c9b-40d7-a6b5-2d3a2461cbbe service nova] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1438.701654] env[69358]: INFO networking_nsxv3.common.synchronization [req-a57cacd6-b3d5-49ce-9b5c-b550041f1b28 req-2e0d3525-9c9b-40d7-a6b5-2d3a2461cbbe service nova] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1438.701654] env[69358]: INFO networking_nsxv3.common.synchronization [req-a57cacd6-b3d5-49ce-9b5c-b550041f1b28 req-2e0d3525-9c9b-40d7-a6b5-2d3a2461cbbe service nova] Enqueued Resource ID: b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7 with Priority: HIGHEST for action port [ 1438.701898] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_rules [ 1438.702032] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1438.702457] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7 with Priority: HIGHEST for action port [ 1438.702792] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.702902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.702970] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.703407] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.703407] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.704201] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.704294] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.704498] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.704599] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.704725] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.704808] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.704868] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.891704] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.891842] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.891935] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.892165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.892262] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.892500] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.892639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.892639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.892776] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.892855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.892942] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71b98808-4982-4022-a948-dbfdb245f026 is going to be updated. [ 1438.919848] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.919978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.920076] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.920240] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.920373] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.928271] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71b98808-4982-4022-a948-dbfdb245f026 in Status: IN_PROGRESS for 2s [ 1439.207519] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.207863] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.207863] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7 with status ACTIVE [ 1439.208047] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.208236] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.208325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.208657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.208783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.208987] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.209131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.209215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.209460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.209591] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.210927] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.210927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.210927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.210927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.210927] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.210927] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7 is going to be updated. [ 1439.231511] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.231699] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.231749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.231997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.232626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.232626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9ea37fa-ad69-44dd-9f0e-8d9760e3aba7" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.266113] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2756cb-20c7-414b-95dc-777acf1f02b2 in Status: SUCCESS [ 1439.266282] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 deletion is rescheduled due to dependency. [ 1439.266386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.692453] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1439.692637] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 deletion is rescheduled due to dependency. [ 1439.692749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.692906] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.693134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.693313] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.693429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.693497] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.693643] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.693724] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.693822] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.196362] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.698265] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.938141] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71b98808-4982-4022-a948-dbfdb245f026 in Status: SUCCESS [ 1440.938329] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71b98808-4982-4022-a948-dbfdb245f026 deletion is rescheduled due to dependency. [ 1440.938466] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.202114] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.202114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.202114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.202114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.202114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.202114] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1441.230053] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.230053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.230053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.230053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.230053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.239222] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1443.250335] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1443.250647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.250690] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.250989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.251222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.251346] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.251411] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.251563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.251647] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.251733] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.251826] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.703304] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.703304] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1443.753896] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.256646] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70627b51-3375-41aa-82f3-78ff340110c2: rpc.has_security_group_logging(os_id): False [ 1444.273055] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.273239] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.273293] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.273472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.273563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.273810] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.273908] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.273971] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.274137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.274217] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.274304] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1444.329940] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.330158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.330158] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.330357] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.330516] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.347523] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1446.362797] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1446.363163] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.704815] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.705211] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.988442] env[69358]: INFO networking_nsxv3.common.synchronization [req-e082d8d6-cab4-4208-8ac0-bdf76612df99 req-d593ec9e-72cb-4184-87f7-53ce90569760 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_members [ 1449.989077] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGHEST for action security_group_members [ 1449.989391] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.989517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.989584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.989783] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.989954] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.990081] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.990165] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.990332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.990440] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.990542] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.492952] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.493187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.493187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.493365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.493457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.493651] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.493794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.493859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.494029] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.494115] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.494203] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd280dae-d447-4168-a710-34cbb550aeef is going to be updated. [ 1450.520687] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.520895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.520895] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.521080] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.521215] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.528955] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd280dae-d447-4168-a710-34cbb550aeef in Status: IN_PROGRESS for 2s [ 1452.539031] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd280dae-d447-4168-a710-34cbb550aeef in Status: SUCCESS [ 1452.539388] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd280dae-d447-4168-a710-34cbb550aeef deletion is rescheduled due to dependency. [ 1452.539388] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.627492] env[69358]: INFO networking_nsxv3.common.synchronization [None req-501be959-3d75-4ad0-89a0-02a40933ba58 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_rules [ 1454.628691] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_rules [ 1454.629149] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.629332] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.629446] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.629814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.629950] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.698894] env[69358]: INFO networking_nsxv3.common.synchronization [None req-cce5da09-7f20-4bc8-bb08-ab76b02a9ffc tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_rules [ 1454.699383] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_rules [ 1454.699707] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.699815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.152600] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.152600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.152600] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.152902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.152902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.152902] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b already deleted. [ 1455.152902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.153062] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.153339] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.153339] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.671480] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.671815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.671815] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.671942] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.672046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.672588] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b already deleted. [ 1455.672588] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.700611] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.700908] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.199103] env[69358]: INFO networking_nsxv3.common.synchronization [req-5eb9e7fd-ca16-4b2f-892e-84cb65bb18df req-1469075f-7c93-45ef-ad45-428a1b4d39cf tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_members [ 1461.199391] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_members [ 1461.199796] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.199924] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.199992] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.200434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.200595] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.200698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.200764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.200914] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.201722] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.201722] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.459018] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.459231] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.459362] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.459641] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.459905] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.460072] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.460195] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.460409] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.460555] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.460789] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1461.460908] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1461.461031] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1461.461142] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1461.461304] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1461.461458] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1461.461686] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1461.481407] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1461.481559] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1461.481703] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1461.481875] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.482175] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-9afe4d93-5fed-4d4c-8b94-14c35370cc64 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.482347] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-9afe4d93-5fed-4d4c-8b94-14c35370cc64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.482471] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-9afe4d93-5fed-4d4c-8b94-14c35370cc64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.482779] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-9afe4d93-5fed-4d4c-8b94-14c35370cc64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.482928] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9afe4d93-5fed-4d4c-8b94-14c35370cc64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.703598] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.703799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.703799] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.704052] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.704184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.704997] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.704997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.704997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.704997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.704997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.704997] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b already deleted. [ 1461.704997] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.984571] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.984796] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.984933] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.985231] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.985389] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.985547] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 9afe4d93-5fed-4d4c-8b94-14c35370cc64 not found, creating... [ 1461.985805] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.985968] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.986101] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.986321] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.986461] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.986795] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.986965] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.987102] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.987317] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.987457] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.987599] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 9afe4d93-5fed-4d4c-8b94-14c35370cc64 is going to be created. [ 1462.008653] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.008849] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.009037] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.009238] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.009463] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.009739] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-9afe4d93-5fed-4d4c-8b94-14c35370cc64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.668154] env[69358]: INFO networking_nsxv3.common.synchronization [req-5eb9e7fd-ca16-4b2f-892e-84cb65bb18df req-4bd78b59-b8f9-4eee-b08c-6d2d045ab538 service nova] Enqueued Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_rules [ 1462.668389] env[69358]: INFO networking_nsxv3.common.synchronization [req-5eb9e7fd-ca16-4b2f-892e-84cb65bb18df req-4bd78b59-b8f9-4eee-b08c-6d2d045ab538 service nova] Enqueued Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_members [ 1462.668510] env[69358]: INFO networking_nsxv3.common.synchronization [req-5eb9e7fd-ca16-4b2f-892e-84cb65bb18df req-4bd78b59-b8f9-4eee-b08c-6d2d045ab538 service nova] Enqueued Resource ID: 9afe4d93-5fed-4d4c-8b94-14c35370cc64 with Priority: HIGHEST for action port [ 1462.668722] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_rules [ 1462.668858] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_members [ 1462.668954] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afe4d93-5fed-4d4c-8b94-14c35370cc64 with Priority: HIGHEST for action port [ 1462.669498] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.669639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.669703] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.669910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.669995] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.670863] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.671017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.671091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.671218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.671360] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.671463] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.671517] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.671635] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.671719] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.671808] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.672534] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-9afe4d93-5fed-4d4c-8b94-14c35370cc64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.674072] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9afe4d93-5fed-4d4c-8b94-14c35370cc64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.674146] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9afe4d93-5fed-4d4c-8b94-14c35370cc64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.674426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9afe4d93-5fed-4d4c-8b94-14c35370cc64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.674426] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9afe4d93-5fed-4d4c-8b94-14c35370cc64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.175697] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.177051] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.177051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.177338] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9afe4d93-5fed-4d4c-8b94-14c35370cc64 with status ACTIVE [ 1463.177504] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.177611] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.177678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.177874] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.177965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.178143] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.178271] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.178298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.178430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.178506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.178723] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.178822] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.178866] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.179017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.179091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.179173] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9afe4d93-5fed-4d4c-8b94-14c35370cc64 is going to be updated. [ 1463.198554] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.198711] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.198763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.198911] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.199046] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.199193] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9afe4d93-5fed-4d4c-8b94-14c35370cc64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.677735] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.180222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.180401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.180434] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.180664] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.180752] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.180852] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b is going to be created. [ 1464.205702] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.205869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.205869] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.206021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.206170] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.216759] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b in Status: UNINITIALIZED for 2s [ 1466.226970] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b in Status: SUCCESS [ 1466.227319] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.227381] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.227569] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.227754] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.227870] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.227934] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.228137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.228222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.228311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.228400] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.730386] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.232851] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be42b8dd-c9e1-4926-884f-558c8f0c1f9b: rpc.has_security_group_logging(os_id): False [ 1467.254104] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.254265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.254341] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.254537] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.254627] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.254874] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.254976] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.255053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.255201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.255278] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.255365] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b is going to be created. [ 1467.325117] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.325259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.325308] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.325501] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.325674] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.345092] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b in Status: IN_PROGRESS for 2s [ 1467.670404] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.670572] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1469.357723] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b in Status: SUCCESS [ 1469.357963] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.671582] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.671925] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.672367] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.672726] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.673841] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.673841] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.674872] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.675138] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.675640] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.675640] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.675992] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.676353] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.574938] env[69358]: INFO networking_nsxv3.common.synchronization [req-a7372f60-3004-42bf-9ec9-f5261103efd0 req-01beb5b4-47a6-4a6a-bf27-dbfb70c67904 tempest-ServerActionsTestJSON-80967130 tempest-ServerActionsTestJSON-80967130-project-member] Enqueued Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1499.575481] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70627b51-3375-41aa-82f3-78ff340110c2 with Priority: HIGHEST for action security_group_members [ 1499.575787] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-70627b51-3375-41aa-82f3-78ff340110c2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.575910] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.575977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.576189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.576342] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.576438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.576511] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.576640] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.576731] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.576810] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70627b51-3375-41aa-82f3-78ff340110c2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.079452] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.079648] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.079747] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.079945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.080053] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.080259] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.080384] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.080430] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.080554] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.080632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.080720] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 is going to be updated. [ 1500.108712] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.108878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.108878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.109065] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.109222] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.116982] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 2s [ 1502.126867] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: IN_PROGRESS for 4s [ 1504.137716] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70627b51-3375-41aa-82f3-78ff340110c2 in Status: SUCCESS [ 1504.137716] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70627b51-3375-41aa-82f3-78ff340110c2 deletion is rescheduled due to dependency. [ 1504.137716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70627b51-3375-41aa-82f3-78ff340110c2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.576885] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.576973] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.577721] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.577721] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1514.578269] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.578546] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1519.579833] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.580217] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.445299] env[69358]: INFO networking_nsxv3.common.synchronization [req-d719f7e1-7e9e-4454-8418-be831779f0db req-8d73270e-ca50-440f-af3c-3e37d0dd2643 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_members [ 1522.445890] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGHEST for action security_group_members [ 1522.446222] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.446358] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.446435] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.446632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.446789] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.446888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.446951] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.447097] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.447183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.447315] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.950370] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.950584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.950584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.950809] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.950902] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.951113] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.951209] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.951274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.951421] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.951499] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.951584] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b is going to be updated. [ 1522.978117] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.978269] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.978311] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.978449] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.978586] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.986244] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b in Status: IN_PROGRESS for 2s [ 1524.996588] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b in Status: SUCCESS [ 1524.996945] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b deletion is rescheduled due to dependency. [ 1524.996945] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.446982] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.447392] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.142171] env[69358]: INFO networking_nsxv3.common.synchronization [None req-0a87ba1c-ac72-44ba-b8ba-eaa50f1846d2 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_rules [ 1528.142662] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_rules [ 1528.142964] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0656236f-3412-4170-a102-a2d8286cb0fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.143109] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.143178] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.143457] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.143542] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.205711] env[69358]: INFO networking_nsxv3.common.synchronization [None req-7803f88f-2f4b-4816-a40a-55982548ae11 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_rules [ 1528.205912] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_rules [ 1528.206467] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0656236f-3412-4170-a102-a2d8286cb0fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.206639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.664009] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.664340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.664340] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.664442] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.664571] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.664619] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0656236f-3412-4170-a102-a2d8286cb0fd already deleted. [ 1528.664706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.664848] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.665010] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.665100] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.184659] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.184890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.184890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.185095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.185184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.185292] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0656236f-3412-4170-a102-a2d8286cb0fd already deleted. [ 1529.185360] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.207375] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.207707] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.369380] env[69358]: INFO networking_nsxv3.common.synchronization [req-352c5d55-3887-4441-a4af-bd06babae42b req-7a7b51a8-b34b-4b75-b27b-565ea154a6dd tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_members [ 1533.369932] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_members [ 1533.370246] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0656236f-3412-4170-a102-a2d8286cb0fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.370981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.370981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.370981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.370981] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.370981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.370981] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.371310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.371310] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.371361] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.613936] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.614177] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.614311] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.614582] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.614847] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.615009] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.615138] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.615350] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.615497] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.615749] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1533.615864] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] NeedRegenerationException {{(pid=69358) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1533.615976] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] no value, waiting for create lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1533.616096] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] value creation lock acquired {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1533.616208] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] No value present for key: 'zone-id' {{(pid=69358) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1533.616317] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Calling creation function for not-yet-present value {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1533.616452] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1533.637429] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1533.637534] env[69358]: DEBUG dogpile.cache.region [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69358) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1533.637633] env[69358]: DEBUG dogpile.lock [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Released creation lock {{(pid=69358) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1533.637807] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "network-209" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.638110] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock port-630abcd4-7e80-4c78-a5df-353b1fbaef2b taken with stack trace [, , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.638297] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "port-630abcd4-7e80-4c78-a5df-353b1fbaef2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.638416] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "port-630abcd4-7e80-4c78-a5df-353b1fbaef2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.638717] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "port-630abcd4-7e80-4c78-a5df-353b1fbaef2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.638860] env[69358]: DEBUG networking_nsxv3.api.rpc [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('630abcd4-7e80-4c78-a5df-353b1fbaef2b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.873703] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.873890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.873890] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.874131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.874223] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.874425] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.874526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.874585] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.874738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.874812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.874894] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0656236f-3412-4170-a102-a2d8286cb0fd already deleted. [ 1533.874975] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.140802] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.141167] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.141237] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.141580] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.141763] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.141890] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Segment Port 630abcd4-7e80-4c78-a5df-353b1fbaef2b not found, creating... [ 1534.142492] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.142658] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.142794] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.143074] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.143235] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.143670] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.144115] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.144115] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.144196] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.144379] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.144566] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Resource: SegmentPort with ID: 630abcd4-7e80-4c78-a5df-353b1fbaef2b is going to be created. [ 1534.164496] env[69358]: DEBUG networking_nsxv3.common.locking [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.164668] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.164826] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.165113] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.165353] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.165579] env[69358]: DEBUG oslo_concurrency.lockutils [None req-afc555d8-9392-4399-a2ce-f168e9fdc0bc None None] Releasing lock "port-630abcd4-7e80-4c78-a5df-353b1fbaef2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.824046] env[69358]: INFO networking_nsxv3.common.synchronization [req-352c5d55-3887-4441-a4af-bd06babae42b req-027509d6-0ef7-469d-a0dc-b9db22bb99ed service nova] Enqueued Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_rules [ 1534.824311] env[69358]: INFO networking_nsxv3.common.synchronization [req-352c5d55-3887-4441-a4af-bd06babae42b req-027509d6-0ef7-469d-a0dc-b9db22bb99ed service nova] Enqueued Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_members [ 1534.824406] env[69358]: INFO networking_nsxv3.common.synchronization [req-352c5d55-3887-4441-a4af-bd06babae42b req-027509d6-0ef7-469d-a0dc-b9db22bb99ed service nova] Enqueued Resource ID: 630abcd4-7e80-4c78-a5df-353b1fbaef2b with Priority: HIGHEST for action port [ 1534.824861] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_rules [ 1534.825036] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_members [ 1534.825166] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 630abcd4-7e80-4c78-a5df-353b1fbaef2b with Priority: HIGHEST for action port [ 1534.825407] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0656236f-3412-4170-a102-a2d8286cb0fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.825528] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.825597] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.825803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.825883] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.826688] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0656236f-3412-4170-a102-a2d8286cb0fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.826800] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.826867] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.827068] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.827281] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.827344] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.827386] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.827563] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.827669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.827765] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.828494] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock port-630abcd4-7e80-4c78-a5df-353b1fbaef2b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.828639] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-630abcd4-7e80-4c78-a5df-353b1fbaef2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.828669] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-630abcd4-7e80-4c78-a5df-353b1fbaef2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.828807] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-630abcd4-7e80-4c78-a5df-353b1fbaef2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.828883] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('630abcd4-7e80-4c78-a5df-353b1fbaef2b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.331526] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0656236f-3412-4170-a102-a2d8286cb0fd taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.331657] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.333416] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.333416] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 630abcd4-7e80-4c78-a5df-353b1fbaef2b with status ACTIVE [ 1535.333416] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.333416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.333416] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.334021] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.335024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.335024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.335024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.335024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.335024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.335024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.335024] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.335024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.335024] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.335354] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.335427] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.335468] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 630abcd4-7e80-4c78-a5df-353b1fbaef2b is going to be updated. [ 1535.356767] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.356907] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.356953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.357134] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.357259] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.357406] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-630abcd4-7e80-4c78-a5df-353b1fbaef2b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.837317] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.339299] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.339502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.339502] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.339764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.339857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.339957] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0656236f-3412-4170-a102-a2d8286cb0fd is going to be created. [ 1536.363728] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.363881] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.363928] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.364131] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.364282] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.372871] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0656236f-3412-4170-a102-a2d8286cb0fd in Status: UNINITIALIZED for 2s [ 1538.383853] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0656236f-3412-4170-a102-a2d8286cb0fd in Status: SUCCESS [ 1538.384235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.384235] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.384478] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.384679] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.384794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.384859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.385034] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.385119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.385201] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.385290] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.887780] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.391044] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0656236f-3412-4170-a102-a2d8286cb0fd: rpc.has_security_group_logging(os_id): False [ 1539.408383] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.408539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.408580] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.408786] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.408875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.409117] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.409218] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.409305] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.409462] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.409539] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.409644] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0656236f-3412-4170-a102-a2d8286cb0fd is going to be created. [ 1539.467327] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.467437] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.467526] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.467680] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.467851] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.477883] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0656236f-3412-4170-a102-a2d8286cb0fd in Status: IN_PROGRESS for 2s [ 1539.826674] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1539.826810] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1541.496063] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0656236f-3412-4170-a102-a2d8286cb0fd in Status: SUCCESS [ 1541.496414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.828518] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1544.828839] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1549.830220] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1549.830604] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1554.831680] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1554.832048] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.832576] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.832576] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.539054] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1561.539445] env[69358]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0eb3e0c1-ca52-43d6-9e21-230988a65c41 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1564.834058] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.834456] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1569.835513] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.835888] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1574.836167] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.836556] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.837376] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1579.837736] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1584.838937] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1584.839365] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1589.839506] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1589.839892] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1594.498528] env[69358]: INFO networking_nsxv3.common.synchronization [req-33431ae2-eec6-4034-a54c-20f36b9b06a6 req-94f49ec0-c9f9-4a16-995e-60d5553091a5 tempest-AttachVolumeNegativeTest-1074714382 tempest-AttachVolumeNegativeTest-1074714382-project-member] Enqueued Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_members [ 1594.499087] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGHEST for action security_group_members [ 1594.499362] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock member-0656236f-3412-4170-a102-a2d8286cb0fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.499490] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.499557] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.499763] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.499910] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.500028] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.500091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.500228] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.500321] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.500432] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.005562] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.005742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.005742] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.005953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.006060] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.006258] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.006352] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.006415] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.006567] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.006644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.006760] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0656236f-3412-4170-a102-a2d8286cb0fd is going to be updated. [ 1595.040226] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.040374] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.040482] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.040606] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.040751] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.051381] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0656236f-3412-4170-a102-a2d8286cb0fd in Status: IN_PROGRESS for 2s [ 1597.061926] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0656236f-3412-4170-a102-a2d8286cb0fd in Status: SUCCESS [ 1597.062317] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0656236f-3412-4170-a102-a2d8286cb0fd deletion is rescheduled due to dependency. [ 1597.062317] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.500949] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.500949] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1604.501977] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1604.502373] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1609.503427] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1609.503750] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1614.504815] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1614.505230] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.506331] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1619.506679] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1620.475529] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1620.475729] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1620.475788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1620.475978] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1620.476109] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1620.977932] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.479925] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.982122] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1621.982470] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1622.694952] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.695188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.695188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.695378] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.834542] env[69358]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1622.835419] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.836487] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1622.871594] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.871794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.871794] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.872017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.885184] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.885935] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1622.886040] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1622.886139] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1622.915735] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.916063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.916063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.916168] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.916878] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.917038] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1622.987152] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.987514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.987514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.987574] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.987859] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.988141] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1623.055364] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.055565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.055565] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.055773] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.056061] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.056313] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:27. [ 1623.056405] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'71b98808-4982-4022-a948-dbfdb245f026', '0656236f-3412-4170-a102-a2d8286cb0fd', 'be42b8dd-c9e1-4926-884f-558c8f0c1f9b', 'b8ab349f-7df0-40a9-a595-1a8e298f956a', '0e7da1ca-32ca-4463-86e0-e62b1a908a4a', '9495602c-f01c-4935-941b-dacd2d1ea667', '193bc791-0b82-49f5-a278-c6f34ab0eaf3', '1eb445c3-23e7-4fd9-a847-f86f9e461f64', 'e9b439f6-daaf-4792-b3c7-d618e26ce5f4', 'd18a7451-b9c3-48be-82ef-e20729d3779a', 'cd280dae-d447-4168-a710-34cbb550aeef', 'd904f37a-b3f7-4aef-9721-265081cb343b', 'b2c85ab1-5f4b-4878-9858-c616793b3b32', '1426a21d-d3c6-4fed-bbe0-ee2b64373b73', '32d20126-9c39-42b2-acda-4aa519da54c6', 'a1e4e649-079d-4cd0-98f4-699005461275', 'db2756cb-20c7-414b-95dc-777acf1f02b2', '75c45f18-eee4-4639-b07a-413cc1624dbc', '46002bc2-9685-44d1-a0f5-f9a4ebc7e375', '98a5293d-e48e-493b-ac38-3a76cc74a5db', 'fd2c3b18-33a0-460a-a199-3124440c68e8', 'b755d42e-d250-4f75-9179-3ef054a079c6', '70627b51-3375-41aa-82f3-78ff340110c2', 'ca6990b0-078a-4815-9003-99ea585a4222', '662b0a83-6546-43c9-93f7-23997583fecf', '3c21f0b2-3055-4df5-9afa-fd29cf1279d5', 'b753fa61-5f01-4b27-9adf-adec33a7b29e'} {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1623.056491] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1623.073737] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.073889] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.073932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.074103] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.074189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.074313] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1623.074382] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1623.074446] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1623.143244] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.143414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.143414] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.143617] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.144734] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.144975] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1623.145064] env[69358]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69358) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1623.145134] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1623.145201] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1623.145277] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/27 resources of Type:Security Group Rules [ 1623.145349] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGH for action security_group_rules [ 1623.145428] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGH for action security_group_rules [ 1623.145494] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGH for action security_group_rules [ 1623.145555] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGH for action security_group_rules [ 1623.145612] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGH for action security_group_rules [ 1623.145677] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGH for action security_group_rules [ 1623.145734] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGH for action security_group_rules [ 1623.145794] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGH for action security_group_rules [ 1623.145856] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGH for action security_group_rules [ 1623.145913] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGH for action security_group_rules [ 1623.145968] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGH for action security_group_rules [ 1623.146033] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGH for action security_group_rules [ 1623.146093] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGH for action security_group_rules [ 1623.146201] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGH for action security_group_rules [ 1623.146201] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGH for action security_group_rules [ 1623.146267] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGH for action security_group_rules [ 1623.146331] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGH for action security_group_rules [ 1623.146376] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGH for action security_group_rules [ 1623.146427] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGH for action security_group_rules [ 1623.146491] env[69358]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGH for action security_group_rules [ 1623.146584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.507093] env[69358]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b98808-4982-4022-a948-dbfdb245f026 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d20126-9c39-42b2-acda-4aa519da54c6 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c45f18-eee4-4639-b07a-413cc1624dbc with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2756cb-20c7-414b-95dc-777acf1f02b2 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e4e649-079d-4cd0-98f4-699005461275 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d904f37a-b3f7-4aef-9721-265081cb343b with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd280dae-d447-4168-a710-34cbb550aeef with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18a7451-b9c3-48be-82ef-e20729d3779a with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9495602c-f01c-4935-941b-dacd2d1ea667 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a with Priority: HIGH for action security_group_rules [ 1624.509513] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0656236f-3412-4170-a102-a2d8286cb0fd with Priority: HIGH for action security_group_rules [ 1624.511032] env[69358]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ab349f-7df0-40a9-a595-1a8e298f956a with Priority: HIGH for action security_group_rules [ 1624.511032] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71b98808-4982-4022-a948-dbfdb245f026 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.511032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.511032] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.515016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.515016] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71b98808-4982-4022-a948-dbfdb245f026',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.515016] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.515016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.515016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.515016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.515016] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be42b8dd-c9e1-4926-884f-558c8f0c1f9b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.515016] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.515016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.515016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.515016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.515016] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('193bc791-0b82-49f5-a278-c6f34ab0eaf3',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.515840] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d20126-9c39-42b2-acda-4aa519da54c6 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.516102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.516315] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.516579] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.516822] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d20126-9c39-42b2-acda-4aa519da54c6',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.517622] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98a5293d-e48e-493b-ac38-3a76cc74a5db taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.517888] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.518091] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.518577] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.518757] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98a5293d-e48e-493b-ac38-3a76cc74a5db',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.520063] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.520063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.520063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.520063] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.520063] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46002bc2-9685-44d1-a0f5-f9a4ebc7e375',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.521381] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75c45f18-eee4-4639-b07a-413cc1624dbc taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.521633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.521923] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.522189] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.522381] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75c45f18-eee4-4639-b07a-413cc1624dbc',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.523191] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db2756cb-20c7-414b-95dc-777acf1f02b2 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.523444] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.523707] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.526027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.526027] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db2756cb-20c7-414b-95dc-777acf1f02b2',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.526027] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.526027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.526027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.526027] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.526027] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1426a21d-d3c6-4fed-bbe0-ee2b64373b73',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.529853] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1e4e649-079d-4cd0-98f4-699005461275 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.529853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.529853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.529853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.529853] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1e4e649-079d-4cd0-98f4-699005461275',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.529853] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2c85ab1-5f4b-4878-9858-c616793b3b32 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.529853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.529853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.529853] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.529853] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2c85ab1-5f4b-4878-9858-c616793b3b32',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.531176] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d904f37a-b3f7-4aef-9721-265081cb343b taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.531445] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.531626] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.532077] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.532282] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d904f37a-b3f7-4aef-9721-265081cb343b',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.533355] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd280dae-d447-4168-a710-34cbb550aeef taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.533633] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.533821] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.534095] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.534390] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd280dae-d447-4168-a710-34cbb550aeef',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.535464] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d18a7451-b9c3-48be-82ef-e20729d3779a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.537171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.537171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.537171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.537171] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d18a7451-b9c3-48be-82ef-e20729d3779a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.537171] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.537171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.537171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.537171] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.537171] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9b439f6-daaf-4792-b3c7-d618e26ce5f4',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.540119] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9495602c-f01c-4935-941b-dacd2d1ea667 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.540119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.540119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.540119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.540119] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9495602c-f01c-4935-941b-dacd2d1ea667',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.540119] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64 taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.540119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.540119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.540119] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.540119] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb445c3-23e7-4fd9-a847-f86f9e461f64',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.541436] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.541788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.541977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.542274] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.542471] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7da1ca-32ca-4463-86e0-e62b1a908a4a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.543325] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0656236f-3412-4170-a102-a2d8286cb0fd taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.543597] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.543793] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.544069] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.545016] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0656236f-3412-4170-a102-a2d8286cb0fd',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.545016] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8ab349f-7df0-40a9-a595-1a8e298f956a taken with stack trace [, , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.545016] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.545418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.545672] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.545939] env[69358]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8ab349f-7df0-40a9-a595-1a8e298f956a',) {} {{(pid=69358) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.605044] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.605814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.605814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.605814] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.608052] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.608220] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.609730] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.609901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.610512] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.610618] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.611825] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.611925] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.616506] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.616620] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.618301] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.618418] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.619117] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.619219] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.619815] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.619920] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.621709] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.621819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.622497] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.622613] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.623163] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1624.623571] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.623663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.624233] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1624.624599] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.624671] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.625248] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1624.625636] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.625744] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71b98808-4982-4022-a948-dbfdb245f026 is going to be deleted. [ 1624.627013] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.627139] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.627200] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.627345] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.628745] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.628876] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.644347] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1624.644706] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.644810] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb445c3-23e7-4fd9-a847-f86f9e461f64 is going to be deleted. [ 1624.645506] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.645665] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.663107] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.663227] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d18a7451-b9c3-48be-82ef-e20729d3779a is going to be deleted. [ 1624.663871] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.664075] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.685155] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.685289] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98a5293d-e48e-493b-ac38-3a76cc74a5db is going to be deleted. [ 1624.685917] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.686094] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.696269] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.696390] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.699125] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.699207] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.705084] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.705189] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8ab349f-7df0-40a9-a595-1a8e298f956a is going to be deleted. [ 1624.705849] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.706017] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.723797] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.723901] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.725922] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.726044] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9495602c-f01c-4935-941b-dacd2d1ea667 is going to be deleted. [ 1624.726698] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.726858] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.795472] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.795561] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7da1ca-32ca-4463-86e0-e62b1a908a4a is going to be deleted. [ 1624.796334] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.796514] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.816079] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.816176] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.816754] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.816854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.832705] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.832819] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.849214] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.849340] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2c85ab1-5f4b-4878-9858-c616793b3b32 is going to be deleted. [ 1624.850070] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.850289] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.917686] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.917865] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be42b8dd-c9e1-4926-884f-558c8f0c1f9b is going to be deleted. [ 1624.918593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.918789] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.939253] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.939423] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.947812] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.947945] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 193bc791-0b82-49f5-a278-c6f34ab0eaf3 is going to be deleted. [ 1624.948655] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.948838] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.999831] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.999990] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d20126-9c39-42b2-acda-4aa519da54c6 is going to be deleted. [ 1625.000663] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.000884] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.063358] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.063500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.079051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.079200] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46002bc2-9685-44d1-a0f5-f9a4ebc7e375 is going to be deleted. [ 1625.079884] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.080087] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.081383] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.081503] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.105430] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.105550] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.106199] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.106291] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.106932] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.107055] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.107657] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.107749] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.123855] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.123978] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1e4e649-079d-4cd0-98f4-699005461275 is going to be deleted. [ 1625.124687] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.124886] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.186985] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.187154] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.187855] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.187989] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.188711] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.188825] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.189767] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.189878] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d904f37a-b3f7-4aef-9721-265081cb343b is going to be deleted. [ 1625.190593] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.190774] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.217114] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.217242] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db2756cb-20c7-414b-95dc-777acf1f02b2 is going to be deleted. [ 1625.217921] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.218083] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.218174] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.218287] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71b98808-4982-4022-a948-dbfdb245f026" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.218429] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.218572] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.218645] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.218756] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb445c3-23e7-4fd9-a847-f86f9e461f64" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.219187] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.219343] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.219426] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.219770] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d18a7451-b9c3-48be-82ef-e20729d3779a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.219840] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.219932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.220012] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.220123] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98a5293d-e48e-493b-ac38-3a76cc74a5db" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.220250] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.220387] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.220456] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.220564] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8ab349f-7df0-40a9-a595-1a8e298f956a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.220732] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.220899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.220977] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.221102] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9495602c-f01c-4935-941b-dacd2d1ea667" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.221265] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.221365] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.221438] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.221530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7da1ca-32ca-4463-86e0-e62b1a908a4a" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.221652] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.221787] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.221862] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.222039] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2c85ab1-5f4b-4878-9858-c616793b3b32" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.222183] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.222325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.257879] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.257999] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75c45f18-eee4-4639-b07a-413cc1624dbc is going to be deleted. [ 1625.258738] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.258940] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.264994] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.265120] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.269517] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.269623] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.288812] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.288953] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.293460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.293591] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0656236f-3412-4170-a102-a2d8286cb0fd is going to be deleted. [ 1625.294327] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.294500] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.333097] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.333188] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.335531] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.335645] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9b439f6-daaf-4792-b3c7-d618e26ce5f4 is going to be deleted. [ 1625.336369] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.336542] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.390682] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.390831] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1426a21d-d3c6-4fed-bbe0-ee2b64373b73 is going to be deleted. [ 1625.391551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.391744] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.461036] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.461160] env[69358]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd280dae-d447-4168-a710-34cbb550aeef is going to be deleted. [ 1625.461899] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.462105] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.462190] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.462309] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be42b8dd-c9e1-4926-884f-558c8f0c1f9b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.462453] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.462601] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.462678] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.462788] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-193bc791-0b82-49f5-a278-c6f34ab0eaf3" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.463227] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.463380] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.463460] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.463584] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d20126-9c39-42b2-acda-4aa519da54c6" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.463716] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.463857] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.463932] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.464056] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46002bc2-9685-44d1-a0f5-f9a4ebc7e375" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.464186] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.464325] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.464401] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.464515] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1e4e649-079d-4cd0-98f4-699005461275" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.464644] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.464771] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.464835] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.464957] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d904f37a-b3f7-4aef-9721-265081cb343b" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.465083] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.465225] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.465298] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.465400] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db2756cb-20c7-414b-95dc-777acf1f02b2" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.466779] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.466912] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.466965] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.467124] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.467199] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.467318] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0656236f-3412-4170-a102-a2d8286cb0fd" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.511248] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.511551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.511551] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.511608] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.511728] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.511803] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75c45f18-eee4-4639-b07a-413cc1624dbc" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.522526] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.522650] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.522695] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.522854] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.522929] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.523051] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9b439f6-daaf-4792-b3c7-d618e26ce5f4" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.565587] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.565740] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.565832] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.565931] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.566023] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.566137] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1426a21d-d3c6-4fed-bbe0-ee2b64373b73" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.589969] env[69358]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1625.590409] env[69358]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69358) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.590530] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.590632] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.590764] env[69358]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.590875] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.590996] env[69358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd280dae-d447-4168-a710-34cbb550aeef" {{(pid=69358) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}